Hybrid Federated Learning Framework with Client - Tailored Attentive Feature Extractor for Agricultural Health Monitoring

Antoni Jaszcz, Agnieszka Polowczyk, Alicja Polowczyk, Katarzyna Wiltos, Dawid Polap, Marcin Wozniak

Abstract: Agricultural health monitoring is a critical task in ensuring the stability of modern agriculture. Many plant diseases share visual similarities, making manual inspection both time consuming and error prone, which is why robust and adaptable disease detection frameworks are not only desirable but essential to maintaining a resilient agricultural ecosystem. In this paper, we propose a hybrid federated learning (FL) framework that integrates a globally shared feature extractor with a client-specific self-attentive branch and classifier. The proposed framework uses a global model with both globally shared and client-tailored branches to achieve better performance for specialized tasks in decentralized training scenarios. The experiments were carried out on a Plant Village data set in a scenario, where each client represented a different crop type and faced a different leaf disease classification problem. The proposed solution revolved around the clients sharing the global weights, thus simultaneously contributing towards better feature extraction of the common leaf features, while the specialized segment of the model focused on proper interpretation of the extracted features (via cross-attention mechanism) and direct classification. The results obtained demonstrate the effectiveness of the proposed approach over standard local training, as training with the proposed hybrid FL framework resulted in a perfect classification of the precision 100% of apple leaf disease.