Towards Floating Point-Based Attention-Free LLM: Hybrid PIM with Non-Uniform Data Format and Reduced Multiplications

Open Webpage

Lidong Guo, Zhenhua Zhu, Tengxuan Liu, Xuefei Ning, Shiyao Li, Guohao Dai, Huazhong Yang, Wangyang Fu, Yu Wang

Published: 01 Jan 2024, Last Modified: 15 May 2025ICCAD 2024EveryoneRevisionsBibTeXCC BY-SA 4.0