NEFTune: Noisy Embeddings Improve Instruction Finetuning

Open Webpage

Neel Jain, Ping-yeh Chiang, Yuxin Wen, John Kirchenbauer, Hong-Min Chu, Gowthami Somepalli, Brian R. Bartoldson, Bhavya Kailkhura, Avi Schwarzschild, Aniruddha Saha, Micah Goldblum, Jonas Geiping, Tom Goldstein

Published: 01 Jan 2024, Last Modified: 15 May 2025ICLR 2024EveryoneRevisionsBibTeXCC BY-SA 4.0