Gergely Szilvasy

Researcher, Meta

Joined

September 2023

Names

Gergely Szilvasy (Preferred)

Emails

****@meta.com (Confirmed)

Personal Links

Career & Education History

Researcher

Meta (meta.com)

2022 – Present

Advisors, Relations & Conflicts

No relations added

Expertise

No areas of expertise listed

Publications

Stochastic activations
Maria Lomeli, Matthijs Douze, Gergely Szilvasy, Loïc Cabannes, Sainbayar Sukhbaatar, Jason E Weston, Gabriel Synnaeve, Pierre-Emmanuel Mazare, Herve Jegou
- Submitted to ICLR 2026
- Readers: Everyone
Short Window Attention Enables Long-Term Memorization
Loïc Cabannes, Maximilian Beck, Maria Lomeli, Gergely Szilvasy, Matthijs Douze, Jade Copet, Pierre-Emmanuel Mazare, Gabriel Synnaeve, Herve Jegou
- ICLR 2026 Poster
- Readers: Everyone

Co-Authors