Siddarth Venkatraman

PhD student, Université de Montréal

Joined

June 2022

Names

Siddarth Venkatraman (Preferred)

Emails

****@andrew.cmu.edu (Confirmed)

****@gmail.com (Confirmed)

****@mila.quebec (Confirmed)

Personal Links

Google Scholar

DBLP

ORCID

Career & Education History

PhD student

Université de Montréal (umontreal.ca)

2023 – 2027

MS student

Carnegie Mellon University (cmu.edu)

2021 – 2023

Undergrad student

Manipal University (manipal.edu)

2017 – 2021

Advisors, Relations & Conflicts

PhD Advisor

Glen Berseth

2023 – Present

PhD Advisor

Jeff

2021 – 2023

Expertise

Reinforcement Learning

Present

Publications

A Comedy of Estimators: On KL Regularization in RL Training of LLMs
Vedant Shah, Johan Obando-Ceron, Vineet Jain, Brian R. Bartoldson, Bhavya Kailkhura, Sarthak Mittal, Glen Berseth, Pablo Samuel Castro, Yoshua Bengio, Nikolay Malkin, Moksh Jain, Siddarth Venkatraman, Aaron Courville
- Submitted to ICLR 2026
- Readers: Everyone
Recursive Self-Aggregation Unlocks Deep Thinking in Large Language Models
Siddarth Venkatraman, Vineet Jain, Sarthak Mittal, Vedant Shah, Johan Obando-Ceron, Yoshua Bengio, Brian R. Bartoldson, Bhavya Kailkhura, Guillaume Lajoie, Glen Berseth, Nikolay Malkin, Moksh Jain
- Submitted to ICLR 2026
- Readers: Everyone
Deep Thinking via Recursive Self-Aggregation
Siddarth Venkatraman, Vineet Jain, Sarthak Mittal, Moksh Jain, Vedant Shah, Johan Obando-Ceron, Yoshua Bengio, Brian R. Bartoldson, Bhavya Kailkhura, Guillaume Lajoie, Glen Berseth, Nikolay Malkin
- FoRLM 2025
- Readers: Everyone
Trajectory Balance with Asynchrony: Decoupling Exploration and Learning for Fast, Scalable LLM Post-Training
Brian R. Bartoldson, Siddarth Venkatraman, James Diffenderfer, Moksh Jain, Tal Ben-Nun, Seanie Lee, Minsu Kim, Johan Obando-Ceron, Yoshua Bengio, Bhavya Kailkhura
- NeurIPS 2025 poster
- Readers: Everyone
Solving Bayesian inverse problems with diffusion priors and off-policy RL
Luca Scimeca, Siddarth Venkatraman, Moksh Jain, Minsu Kim, Marcin Sendera, Mohsin Hasan, Alexandre Adam, Yashar Hezaveh, Laurence Perreault-Levasseur, Yoshua Bengio, Glen Berseth, Nikolay Malkin
- ICLR 2025 DeLTa Workshop Poster
- Readers: Everyone
Outsourced diffusion sampling: Efficient posterior inference in latent spaces of generative models
Siddarth Venkatraman, Mohsin Hasan, Minsu Kim, Luca Scimeca, Marcin Sendera, Yoshua Bengio, Glen Berseth, Nikolay Malkin
- FPI-ICLR2025 Poster
- Readers: Everyone
Outsourced diffusion sampling: Efficient posterior inference in latent spaces of generative models
Siddarth Venkatraman, Mohsin Hasan, Minsu Kim, Luca Scimeca, Marcin Sendera, Yoshua Bengio, Glen Berseth, Nikolay Malkin
- ICLR 2025 DeLTa Workshop Poster
- Readers: Everyone
Outsourced Diffusion Sampling: Efficient Posterior Inference in Latent Spaces of Generative Models
Siddarth Venkatraman, Mohsin Hasan, Minsu Kim, Luca Scimeca, Marcin Sendera, Yoshua Bengio, Glen Berseth, Nikolay Malkin
- ICML 2025 poster
- Readers: Everyone
Amortizing intractable inference in diffusion models for vision, language, and control
Siddarth Venkatraman, Moksh Jain, Luca Scimeca, Minsu Kim, Marcin Sendera, Mohsin Hasan, Luke Rowe, Sarthak Mittal, Pablo Lemos, Emmanuel Bengio, Alexandre Adam, Jarrid Rector-Brooks, Yoshua Bengio, Glen Berseth, Nikolay Malkin
- NeurIPS 2024 poster
- Readers: Everyone
Reasoning with Latent Diffusion in Offline Reinforcement Learning
Siddarth Venkatraman, Shivesh Khaitan, Ravi Tej Akella, John Dolan, Jeff Schneider, Glen Berseth
- ICLR 2024 poster
- Readers: Everyone

View all 16 publications

Co-Authors

View all 46 co-authors