ConSmax: Hardware-Friendly Alternative Softmax with Learnable Parameters

Open Webpage

Shiwei Liu, Guanchen Tao, Yifei Zou, Derek Chow, Zichen Fan, Kauna Lei, Bangfei Pan, Dennis Sylvester, Gregory Kielian, Mehdi Saligane

Published: 27 Oct 2024, Last Modified: 23 Mar 2026CrossrefEveryoneRevisionsCC BY-SA 4.0