AJAY KUMAR JAISWAL

Researcher, Apple

Joined

September 2021

Names

AJAY KUMAR JAISWAL (Preferred)

Emails

****@utexas.edu (Confirmed)

****@apple.com (Confirmed)

Personal Links

Career & Education History

Researcher

Apple (apple.com)

2023 – Present

PhD student

University of Texas, Austin (utexas.edu)

2021 – 2025

Researcher

Amazon (amazon.com)

2022 – 2023

Advisors, Relations & Conflicts

PhD Advisor

Atlas Wang

2021 – 2025

PhD Advisor

Ying Ding

2021 – 2025

Expertise

Large Language Models

Present

Foundational Models

Present

Sparse Neural Networks

Present

Pruning

Present

Publications

On the Efficiency of Structured Pruning in Small Language Model Pretraining
Yixiao Li, Xianzhi Du, AJAY KUMAR JAISWAL, Tao Lei, Tuo Zhao, Chong Wang, Jianyu Wang
- Submitted to ICLR 2026
- Readers: Everyone
MAPLE: Masked Adapter Prototype Learning for OOD generalization
Adarsh Kappiyath, Abhra Chaudhuri, Jiaxi Li, AJAY KUMAR JAISWAL, Xilu Wang, Li Shen, Souvik Kundu, Xiatian Zhu, Lu Yin
- Submitted to ICLR 2026
- Readers: Everyone
Double-Checker: Enhancing Reasoning of Slow-Thinking LLMs via Self-Critical Fine-Tuning
Xin Xu, Tianhao Chen, Fan Zhang, Wanlong Liu, Pengxiang Li, AJAY KUMAR JAISWAL, Yuchen Yan, Jishan Hu, Yang Wang, Hao Chen, Shiwei Liu, Shizhe Diao, Can Yang, Lu Yin
- Submitted to ICLR 2026
- Readers: Everyone
GPAS: Accelerating Convergence of LLM Pretraining via Gradient-Preserving Activation Scaling
Tianhao Chen, Xin Xu, Zijing Liu, Pengxiang Li, Xinyuan Song, AJAY KUMAR JAISWAL, Fan Zhang, Jishan Hu, Yang Wang, Hao Chen, Shizhe Diao, Shiwei Liu, Yu Li, Lu Yin, Can Yang
- NeurIPS 2025 poster
- Readers: Everyone
Double-Checker: Enhancing Reasoning of Slow-Thinking LLMs via Self-Critical Fine-Tuning
Xin Xu, Tianhao Chen, Fan Zhang, Wanlong Liu, Pengxiang Li, AJAY KUMAR JAISWAL, Yuchen Yan, Jishan Hu, Yang Wang, Hao Chen, Shiwei Liu, Shizhe Diao, Can Yang, Lu Yin
- Submitted to NeurIPS 2025
- Readers: Everyone
From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories, and Applications
AJAY KUMAR JAISWAL, Yifan Wang, Lu Yin, Shiwei Liu, Runjin Chen, Jiawei Zhao, Ananth Grama, Yuandong Tian, Zhangyang Wang
- ICML 2025 poster
- Readers: Everyone
Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients
Zhenyu Zhang, AJAY KUMAR JAISWAL, Lu Yin, Shiwei Liu, Jiawei Zhao, Yuandong Tian, Zhangyang Wang
- CPAL 2025 (Proceedings Track) Poster
- Readers: Everyone
Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients
Zhenyu Zhang, AJAY KUMAR JAISWAL, Lu Yin, Shiwei Liu, Jiawei Zhao, Yuandong Tian, Zhangyang Wang
- ICLR 2025 Conference Withdrawn Submission
- Readers: Everyone
From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients
AJAY KUMAR JAISWAL, Lu Yin, Zhenyu Zhang, Shiwei Liu, Jiawei Zhao, Yuandong Tian, Zhangyang Wang
- Submitted to ICLR 2025
- Readers: Everyone
Fantastic Experts and How to Find Them: A Multi-Dimensional Study for Experts-Level Sparsification in Mixture-of-Experts
AJAY KUMAR JAISWAL, Jianyu Wang, Yixiao Li, Pingzhi Li, Tianlong Chen, Zhangyang Wang, Chong Wang, Ruoming Pang, Xianzhi Du
- Submitted to ICLR 2025
- Readers: Everyone

View all 42 publications

Co-Authors

View all 107 co-authors