Object Detection in Pineapple Fields Drone Imagery Using Few Shot Learning and the Segment Anything Model

Fabian Fallas-Moya, Saúl Calderón Ramírez, Amir Sadovnik, Hairong Qi

Abstract: Deep Learning Object Detection relies on extensive, manual annotation of datasets, a time-consuming and costly process prone to human inconsistencies. Auto-labeling using Visual Foundation Models offers a promising alternative but often falls short in object detection tasks. This research introduces a novel framework that uses the Segment Anything Model (SAM) with minimal annotated images to create an effective object detector. Despite the capabilities of Visual Foundation Models in downstream tasks, our research reveals their poor performance in object detection when operating within a different domain. Additionally, we demonstrate that with only a few labeled images, we can create a much better and simpler object detection system. We also prove that our model outperforms the best existing object detectors when it comes to analyzing drone images taken in pineapple fields.