Jiajun Shen

Researcher, DeepMind

Joined

September 2019

Names

Jiajun Shen (Preferred)

Emails

****@fb.com (Confirmed)

****@gmail.com (Confirmed)

****@google.com (Confirmed)

****@deepmind.com (Confirmed)

Personal Links

Google Scholar

DBLP

Career & Education History

Researcher

DeepMind (deepmind.com)

2022 – Present

Research Scientist

Facebook (fb.com)

2017 – 2020

PhD student

University of Chicago (uchicago.edu)

2012 – 2017

Advisors, Relations & Conflicts

PhD Advisor

Yali Amit

2012 – 2017

Expertise

deep learning

graph neural network

machine translation

large language model

2012 – Present

Publications

Streaming DiLoCo with overlapping communication
Arthur Douillard, Yani Donchev, J Keith Rush, Satyen Kale, Zachary Charles, Gabriel Teston, Zachary Garrett, Jiajun Shen, Ross McIlroy, David Lacey, Alexandre Rame, Arthur Szlam, MarcAurelio Ranzato, Paul R Barham
- COLM 2025
- Readers: Everyone
SL3D: Self-supervised-Self-labeled 3D Recognition
Fernando Julio Cendra, Lan Ma, Jiajun Shen, XIAOJUAN QI
- Neural Information Processing Systems Workshop on Self-supervised Learning: Theory & Practice (NeurIPS), 2022
- Readers: Everyone
Asynchronous Local-SGD Training for Language Modeling
Bo Liu, Rachita Chhaparia, Arthur Douillard, Satyen Kale, Andrei Alex Rusu, Jiajun Shen, Arthur Szlam, MarcAurelio Ranzato
- WANT@ICML 2024 Oral
- Readers: Everyone
DiLoCo: Distributed Low-Communication Training of Language Models
Arthur Douillard, Qixuan Feng, Andrei Alex Rusu, Rachita Chhaparia, Yani Donchev, Adhiguna Kuncoro, MarcAurelio Ranzato, Arthur Szlam, Jiajun Shen
- WANT@ICML 2024 Poster
- Readers: Everyone
Reconstruct face from features based on genetic algorithm using GAN generator as a distribution constraint
Xingbo Dong, Zhihui Miao, Lan Ma, Jiajun Shen, Zhe Jin, Zhenhua Guo, Andrew Beng Jin Teoh
- 2023 (modified: 17 Feb 2023)
- Comput. Secur. 2023
- Readers: Everyone
Making the Most of What You Have: Adapting Pre-trained Visual Language Models in the Low-data Regime
Chuhan Zhang, Antoine Miech, Jiajun Shen, Jean-Baptiste Alayrac, Pauline Luc
- Published: 01 Jan 2023, Last Modified: 17 May 2023
- CoRR 2023
- Readers: Everyone
Reconstruct Face from Features Using GAN Generator as a Distribution Constraint
Xingbo Dong, Zhihui Miao, Lan Ma, Jiajun Shen, Zhe Jin, Zhenhua Guo, Andrew Beng Jin Teoh
- 2022 (modified: 11 Nov 2022)
- CoRR 2022
- Readers: Everyone
Abandoning the Bayer-Filter to See in the Dark
Xingbo Dong, Wanyan Xu, Zhihui Miao, Lan Ma, Chao Zhang, Jiewen Yang, Zhe Jin, Andrew Beng Jin Teoh, Jiajun Shen
- 2022 (modified: 11 Nov 2022)
- CVPR 2022
- Readers: Everyone
Video Demoiréing with Relation-Based Temporal Consistency
Peng Dai, Xin Yu, Lan Ma, Baoheng Zhang, Jia Li, Wenbo Li, Jiajun Shen, Xiaojuan Qi
- 2022 (modified: 11 Nov 2022)
- CVPR 2022
- Readers: Everyone
Federated Self-supervised Learning for Video Understanding
Yasar Abbas Ur Rehman, Yan Gao, Jiajun Shen, Pedro Porto Buarque de Gusmão, Nicholas D. Lane
- 2022 (modified: 11 Nov 2022)
- ECCV (31) 2022
- Readers: Everyone

View all 29 publications

Co-Authors

View all 116 co-authors