OpenReview
.net
OpenReview
.net
Login
OpenReview
.net
Login
MarcAurelio Ranzato
Researcher, Google
Joined
September 2016
Names
MarcAurelio Ranzato
(Preferred)
,
Marc'Aurelio Ranzato
,
Marc'aurelio Ranzato
Emails
****@fb.com
(Confirmed)
,
****@cs.toronto.edu
(Confirmed)
,
****@gmail.com
(Confirmed)
,
****@deepmind.com
(Confirmed)
Personal Links
Homepage
Google Scholar
DBLP
Career & Education History
Researcher
Google
(google.com)
2023
–
Present
Researcher
DeepMind
(deepmind.com)
2021
–
2023
Researcher
Facebook
(fb.com)
2013
–
2021
Researcher
Google
(google.com)
2011
–
2013
Postdoc
Department of Computer Science, University of Toronto
(cs.toronto.edu)
2009
–
2011
PhD student
New York University
(cs.nyu.edu)
2004
–
2009
Advisors, Relations & Conflicts
Coauthor
Soumith Chintala
2017
–
Present
Coauthor
Arthur Szlam
2017
–
Present
Coauthor
Yuandong Tian
2017
–
Present
Coauthor
Mark Tygert
2017
–
Present
Coauthor
Lior Wolf
2014
–
2015
Coauthor
trevor darrell
2014
–
2014
Coauthor
Manohar Paluri
2014
–
2014
Coauthor
Lubomir D. Bourdev
2014
–
2014
Coauthor
Yoshua Bengio
2014
–
2014
Coauthor
Ning Zhang
2011
–
2014
Coauthor
Joan Bruna
2011
–
2014
Coauthor
Ming Yang
2011
–
2014
Coauthor
Kevin Swersky
2011
–
2014
Coauthor
Ronan Collobert
2011
–
2014
Coauthor
Marc'aurelio Ranzato
2011
–
2014
Coauthor
David Eigen
2011
–
2014
Coauthor
Armand Joulin
2011
–
2014
Coauthor
Samy Bengio
2011
–
2014
Coauthor
Nando Freitas
2011
–
2014
Coauthor
Matthew Zeiler
2011
–
2014
Coauthor
Armand Joulin
2011
–
2014
Coauthor
Misha Denil
2011
–
2014
Coauthor
Andrew Senior
2011
–
2014
Coauthor
Jonathon Shlens
2011
–
2014
Coauthor
Yann Lecun
2011
–
2014
Coauthor
Andrea Frome
2011
–
2014
Advisor
Geoffrey Hinton
2009
–
2011
Coauthor
Alex Krizhevsky
2010
–
2010
Advisor
Yann Lecun
2004
–
2009
Coauthor
Martin Szummer
2008
–
2008
Advisor
Pietro Perona
2007
–
2007
Expertise
Large-Scale Learning
,
Modularity
,
Continual Learning
,
Deep Learning
,
NLP
,
unsupervised learning
,
Vision
Present
Publications
Streaming DiLoCo with overlapping communication
Arthur Douillard
,
Yani Donchev
,
J Keith Rush
,
Satyen Kale
,
Zachary Charles
,
Gabriel Teston
,
Zachary Garrett
,
Jiajun Shen
,
Ross McIlroy
,
David Lacey
,
Alexandre Rame
,
Arthur Szlam
,
MarcAurelio Ranzato
,
Paul R Barham
COLM 2025
Readers:
Everyone
Asynchronous Local-SGD Training for Language Modeling
Bo Liu
,
Rachita Chhaparia
,
Arthur Douillard
,
Satyen Kale
,
Andrei Alex Rusu
,
Jiajun Shen
,
Arthur Szlam
,
MarcAurelio Ranzato
WANT@ICML 2024 Oral
Readers:
Everyone
DiLoCo: Distributed Low-Communication Training of Language Models
Arthur Douillard
,
Qixuan Feng
,
Andrei Alex Rusu
,
Rachita Chhaparia
,
Yani Donchev
,
Adhiguna Kuncoro
,
MarcAurelio Ranzato
,
Arthur Szlam
,
Jiajun Shen
WANT@ICML 2024 Poster
Readers:
Everyone
ON ANYTIME LEARNING AT MACROSCALE
MarcAurelio Ranzato
OpenReview Archive Direct Upload
Readers:
Everyone
Nevis’22: A Stream of 100 Tasks Sampled from 30 Years of Computer Vision Research
MarcAurelio Ranzato
OpenReview Archive Direct Upload
Readers:
Everyone
Towards Robust and Efficient Continual Language Learning
MarcAurelio Ranzato
OpenReview Archive Direct Upload
Readers:
Everyone
DiLoCo: Distributed Low-Communication Training of Language Models
MarcAurelio Ranzato
OpenReview Archive Direct Upload
Readers:
Everyone
Asynchronous Local-SGD Training for Language Modeling
MarcAurelio Ranzato
OpenReview Archive Direct Upload
Readers:
Everyone
Multi-step Planning for Automated Hyperparameter Optimization with OptFormer
Lucio M. Dery
,
Abram L. Friesen
,
Nando de Freitas
,
MarcAurelio Ranzato
,
Yutian Chen
05 Oct 2022 (modified: 05 May 2023)
FMDM@NeurIPS2022
Readers:
Everyone
Towards Learning Universal Hyperparameter Optimizers with Transformers
Yutian Chen
,
Xingyou Song
,
Chansoo Lee
,
Zi Wang
,
Qiuyi Zhang
,
David Dohan
,
Kazuya Kawakami
,
Greg Kochanski
,
Arnaud Doucet
,
MarcAurelio Ranzato
,
Sagi Perel
,
Nando de Freitas
Published: 31 Oct 2022, Last Modified: 08 Feb 2026
NeurIPS 2022 Accept
Readers:
Everyone
View all 41 publications
Co-Authors
Abdel-rahman Mohamed
Abram L. Friesen
Adhiguna Kuncoro
Alexandre Rame
Alexis Conneau
Alina Beygelzimer
Amanda Levendowski
Andrea Frome
Andrei Alex Rusu
Andrew W. Senior
Andrew Y. Ng
Ann Lee
Antoine Bordes
Arnaud Doucet
Arthur Douillard
Arthur Szlam
Babak Shakibi
Benjamin M. Marlin
Bo Liu
Chansoo Lee
Christopher S. Poultney
David Buchman
David Dohan
David Grangier
David Lacey
View all 98 co-authors