Long-Context Aware Upcycling: A New Frontier for Hybrid LLM Scaling

Open Webpage

Parsa Ashrafi Fashi, Utkarsh Saxena, Mehdi Rezagholizadeh, Aref Jafari, Akash Haridas, Mingyu Yang, Vansh Bhatia, Guihong Li, Vikram Appia, Emad Barsoum

Published: 2026, Last Modified: 28 May 2026CoRR 2026EveryoneRevisionsBibTeXCC BY-SA 4.0