Predicting Dry Pea Maturity Using Machine Learning and Advanced Sensor Fusion with Unmanned Aerial Systems (UASs)

Aliasghar Bazrafkan, Harry Navasca, Jeong-Hwa Kim, Mario Morales, Josephine Princy Johnson, Nadia Delavarpour, Nadeem Fareed, Nonoy Bandillo, Paulo Flores

Maturity is an important trait in dry pea breeding programs, but the conventional process predominately used to measure this trait can be time-consuming, labor-intensive, and prone to errors. Therefore, a more efficient and accurate approach would be desirable to support dry pea breeding programs. This study presents a novel approach for measuring dry pea maturity using machine learning algorithms and unmanned aerial systems (UASs)-collected data. We evaluated the abilities of five machine learning algorithms (random forest, artificial neural network, support vector machine, K-nearest neighbor, and naïve Bayes) to accurately predict dry pea maturity on field plots. The machine learning algorithms considered a range of variables, including crop height metrics, narrow spectral bands, and 18 distinct color and spectral vegetation indices. Backward feature elimination was used to select the most important features by iteratively removing insignificant ones until the model’s predictive performance was optimized. The study’s findings reveal that the most effective approach for assessing dry pea maturity involved a combination of narrow spectral bands, red-edge, near-infrared (NIR), and RGB-based vegetation indices, along with image textural metrics and crop height metrics. The implementation of a random forest model further enhanced the accuracy of the results, exhibiting the highest level of accuracy with a 0.99 value for all three metrics precision, recall, and f1 scores. The sensitivity analysis revealed that spectral features outperformed structural features when predicting pea maturity. While multispectral cameras achieved the highest accuracy, the use of RGB cameras may still result in relatively high accuracy, making them a practical option for use in scenarios where cost is a limiting factor. In summary, this study demonstrated the effectiveness of coupling machine learning algorithms, UASs-borne LIDAR, and multispectral data to accurately assess maturity in peas.