In-Network Collective Operations: Game Changer or Challenge for AI Workloads?

Download PDF
Open Webpage

Torsten Hoefler, Mikhail Khalilov, Josiah Clark, Surendra Anubolu, Mohan Kalkunte, Karen Schramm, Eric Spada, Duncan Roweth, Keith D. Underwood, Adrian M. Caulfield, Abdul Kabbani, Amirreza Rastegari

Published: 2026, Last Modified: 21 Jan 2026Computer 2026EveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: This paper summarizes the opportunities of in-network collective operations for accelerated collective operations in artificial intelligence (AI) workloads. We provide sufficient detail to make this important field accessible to nonexperts in AI or networking, fostering a connection between these communities.