Decentralized Federated Learning in Metacomputing Based on Directed Acyclic Graph With Optimized Tip Selector

Bin Jiang, Bo Zhao, Fei Luo, Huihui Helen Wang, Houbing Herbert Song

Abstract: Metacomputing optimizes distributed computing resources to enhance federated learning (FL) systems by enabling efficient resource allocation, improved scheduling, and greater scalability, thereby addressing challenges in large-scale and dynamic environments. This article proposes an innovative framework integrating directed acyclic graph (DAG) technology with FL within a metacomputing environment. The key contributions include a three-layer decentralized FL model integrating DAG and metacomputing to enhance resilience and scalability, two advanced tip selection models LazyEval tip selector and precision tip selector to optimize node selection and improve data flow, and a benchmark improvement protocol (BIP) for efficient node publishing and role adaptation. The BIP ensures that only high-performing models are published by comparing new models against established benchmarks, which enhances node collaboration and optimizes resource allocation. LazyEval Tip Selector minimizes redundant computations by leveraging a global cache and employing a lazy evaluation strategy, thereby improving computational efficiency. On the other hand, Precision Tip Selector uses a precise scoring mechanism to ensure accurate tip selection, thereby enhancing the robustness and reliability of the entire system. Collectively, these innovations enhance model training efficiency, support real-time updates, and improve the scalability of FL systems, making them well-suited for managing complex, dynamic environments.

External IDs:dblp:journals/iotj/JiangZLWS25