Detection of kernels in maize forage using hyperspectral imaging

In this study, the use of hyperspectral imaging was examined to enhance the kernel processing assessment of maize forage, which is crucial for optimizing the production of dairy cow feed and biogas production. As the visual contrast between the kernels and other crop particles is quite limited, spectral imaging could provide better kernel classification. A pushbroom hyperspectral imaging system was used, scanning samples collected during maize harvesting in the 400–1000 nm range. A PLSDA model for pixel classification was developed to distinguish kernel spectra from the other particles in the forage, achieving a pixel-level classification accuracy of 95.2 %. Next, the most important wavelengths were identified by means of a stepwise procedure using the Wilks Lambda criterion. A Pixel classification using the top five discriminating wavelengths achieved nearly the same accuracy as the full spectrum wavelength model (95.2 % compared to 93.5 %) and did considerably better than the RGB classifier’s 86.3 % accuracy. Finally, these top 5 discriminating wavebands were applied in an object detection deep learning model, more specifically a Faster R-CNN model. While object detection based on these 5 wavebands stilled outperformed object detection based on RGB wavebands, detection performance, as measured by AP50, was rather low. This weak performance resulted from the low resolution of the hyperspectral imaging camera.