Po-Yao Huang

Researcher, FAIR, Meta

Joined

July 2019

Names

Po-Yao Huang (Preferred)

Bernie Huang

Emails

****@gmail.com (Confirmed)

****@cs.cmu.edu (Confirmed)

****@meta.com (Confirmed)

****@fb.com (Confirmed)

Personal Links

Career & Education History

Researcher

FAIR, Meta (meta.com)

2020 – Present

PhD student

Carnegie Mellon University (cmu.edu)

2016 – 2021

MS student

Carnegie Mellon University (cmu.edu)

2014 – 2016

Advisors, Relations & Conflicts

PhD Advisor

Alexander Hauptmann

2014 – 2020

Expertise

Natural language processing

Present

Computer vision

2016 – Present

Machine translation

2016 – Present

Cross-modal retrieval

2016 – Present

Multimodal machine learning

2016 – Present

Publications

Perception Encoder: The best visual embeddings are not at the output of the network
Daniel Bolya, Po-Yao Huang, Peize Sun, Jang Hyun Cho, Andrea Madotto, Chen Wei, Tengyu Ma, Jiale Zhi, Jathushan Rajasegaran, Hanoona Abdul Rasheed, Junke Wang, Marco Monteiro, Hu Xu, Shiyu Dong, Nikhila Ravi, Shang-Wen Li, Piotr Dollar, Christoph Feichtenhofer
- NeurIPS 2025 oral
- Readers: Everyone
PerceptionLM: Open-Access Data and Models for Detailed Visual Understanding
Jang Hyun Cho, Andrea Madotto, Effrosyni Mavroudi, Triantafyllos Afouras, Tushar Nagarajan, Muhammad Maaz, Yale Song, Tengyu Ma, Shuming Hu, Suyog Jain, Miguel Martin, Huiyu Wang, Hanoona Abdul Rasheed, Peize Sun, Po-Yao Huang, Daniel Bolya, Nikhila Ravi, Shashank Jain, Tammy Stark, Seungwhan Moon et al. (9 additional authors not shown)
- NeurIPS 2025 spotlight
- Readers: Everyone
Self-Supervised Audio-Visual Soundscape Stylization
Tingle Li, Renhao Wang, Po-Yao Huang, Andrew Owens, Gopala Anumanchipalli
- ECCV 2024
- Readers: Everyone
Text Quality-Based Pruning for Efficient Training of Language Models
Vasu Sharma, Karthik Padthe, Newsha Ardalani, Kushal Tirumala, Russell Howes, Hu Xu, Po-Yao Huang, Daniel Li Chen, Armen Aghajanyan, Gargi Ghosh, Luke Zettlemoyer
- Accepted by DMLR
- Readers: Everyone
MoDE: CLIP Data Experts via Clustering
Jiawei Ma, Po-Yao Huang, Saining Xie, Shang-Wen Li, Luke Zettlemoyer, Shih-Fu Chang, Wen-tau Yih, Hu Xu
- CVPR 2024
- Readers: Everyone
Demystifying CLIP Data
Hu Xu, Saining Xie, Xiaoqing Tan, Po-Yao Huang, Russell Howes, Vasu Sharma, Shang-Wen Li, Gargi Ghosh, Luke Zettlemoyer, Christoph Feichtenhofer
- ICLR 2024 spotlight
- Readers: Everyone
Learning to Stylize Soundscapes from In-the-Wild Videos
Tingle Li, Renhao Wang, Po-Yao Huang, Andrew Owens, Gopala Anumanchipalli
- ICLR 2024 Conference Withdrawn Submission
- Readers: Everyone
DINOv2: Learning Robust Visual Features without Supervision
Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy V. Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel HAZIZA, Francisco Massa, Alaaeldin El-Nouby, Mido Assran, Nicolas Ballas, Wojciech Galuba, Russell Howes, Po-Yao Huang, Shang-Wen Li, Ishan Misra, Michael Rabbat, Vasu Sharma, Gabriel Synnaeve et al. (6 additional authors not shown)
- Accepted by TMLR
- Readers: Everyone
STMT: A Spatial-Temporal Mesh Transformer for MoCap-Based Action Recognition
Xiaoyu Zhu, Po-Yao Huang, Junwei Liang, Celso M de Melo, Alexander G Hauptmann
- 12 May 2023
- OpenReview Archive Direct Upload
- Readers: Everyone
MAViL: Masked Audio-Video Learners
Po-Yao Huang, Vasu Sharma, Hu Xu, Chaitanya Ryali, Haoqi Fan, Yanghao Li, Shang-Wen Li, Gargi Ghosh, Jitendra Malik, Christoph Feichtenhofer
- NeurIPS 2023 poster
- Readers: Everyone

View all 15 publications

Co-Authors

View all 101 co-authors