MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models

Open Webpage

Elias Frantar, Roberto L. Castro, Jiale Chen, Torsten Hoefler, Dan Alistarh

Published: 01 Jan 2025, Last Modified: 15 May 2025PPoPP 2025EveryoneRevisionsBibTeXCC BY-SA 4.0