A Modern Approach for Classification of Soil Aggregates based on Stereo Vision

Stereo vision is an approach to 3D information from multiple 2D views of a scene. The 3D information can be extracted from a pair image, as known stereo pair by estimating the relative depth of points in the scene.Soil aggregate size distribution is one of the most important issues in the agriculture sector which highly affects energy consumed for preparing the field before planting. Mean weight diameter of clods is a standard metric for determining clod (big aggregates) size. Conventional methods are based on sieving soil samples to calculate the MWD. However, they are faced with several challenges in larger scales and practical applications. Furthermore, due to inherent limitations of soil environment and also being a tedious work, traditional methods would beuse to estimate the metric higher or lower than actual value.As new methods, researchers are using computer vision techniques as virtual sieve so that the size of clods can be determined via processing digital images which have been taken from soil surface. Although, image-based methods have solved many of previous problems, their accuracy is not so high due to the complexity of soil environment and overlapping colds, and needs to be improved. In order to overcome the mentioned challenges, in the current study stereo vision method was developed so that it is possible to extract the third dimension information as height of clods which helps us to categorize clods into their own class.

In this study, the W3-Fujifilm stereo camera equipped with two 10-megapixel CCD sensors for both left and right lenses, and baseline spacing of 7.5 cm was used. The distance between the camera lens and the ground was also set to 60 cm.In order to get three components of soil clods including (x, y, z), point cloud was investigated. For this, local features were extracted using a SIFT feature detector. The SIFT algorithm is robust against scale, rotation and illumination changes, so that these specifications have made it as a strong tool in the field of stereo vision. Then, the extracted features (keypoints) were matched between two stereo pair images by means of Brute Force algorithm and the location of all corresponding points were determined and point cloud was obtained.At the final stage, three features including length, width and height of all six classes of soil clods were entered into a linear classifier entitled discriminant analysis. This classifier as a linear separator classified these six classes based on appropriate functions in a 5 dimensional space.

Results of classification model showed that the height (thickness) of clods have more distinguishing different soil clods. The reason for this refers to the event of overlapping, because most of clods were touched each other after sieving. Consequently, the length and width of clods had not significant effect in soil aggregates classification.In order to analysis the result of soil aggregate classification, confusion matrix was calculated and the overall classification accuracy was achieved 83.7%. The lowest and highest accuracy were obtained for class 1 (the littlest class) and class 6 (the biggest class), respectively due to their low and high height from the soil surface.

In this research, the basic geometrical features including length, width and height were extracted from stereo pair digital images via stereo vision techniques to classify six classes of soil clods. This aim was reached by 3-D reconstruction of image data, so that the height of each image as the third component of (x,y,z) was obtained as well as the length and width. The results of classification indicated that the stereo vision technique had the satisfactory performance in determining the aggregate size distribution which is one of the most important indices for tilled soil quality.