Paul Smolensky

Researcher, Microsoft

Professor, Johns Hopkins University

Joined

October 2017

Names

Paul Smolensky

Emails

****@gmail.com (Confirmed)

****@jhu.edu (Confirmed)

****@microsoft.com (Confirmed)

Personal Links

Career & Education History

Researcher

Microsoft (microsoft.com)

2016 – Present

Professor

Johns Hopkins University (jhu.edu)

1994 – Present

Professor

University of Colorado, Boulder (colorado.edu)

1985 – 1994

Advisors, Relations & Conflicts

No relations added

Expertise

NLP

computational linguistics

2016 – Present

representation analysis

representation learning

2015 – Present

theoretical linguistics

phonology

1990 – Present

systematicity

compositionality

1988 – Present

Publications

Mechanisms of Symbol Processing in Transformers
Paul Smolensky, Roland Fernandez, Zhenghao Zhou, Mattia Opper, Adam Davies, Jianfeng Gao
- CogInterp @ NeurIPS 2025 Oral
- Readers: Everyone
Understanding Attention Glitches with Threshold Relative Attention
Mattia Opper, Roland Fernandez, Paul Smolensky, Jianfeng Gao
- MOSS@ICML2025
- Readers: Everyone
TRA: Better Length Generalisation with Threshold Relative Attention
Mattia Opper, Roland Fernandez, Paul Smolensky, Jianfeng Gao
- Accepted by TMLR
- Readers: Everyone
Compositional Generalization Across Distributional Shifts with Sparse Tree Operations
Paul Soulos, Henry Conklin, Mattia Opper, Paul Smolensky, Jianfeng Gao, Roland Fernandez
- Sys2-Reasoning Poster
- Readers: Everyone
Compositional Generalization Across Distributional Shifts with Sparse Tree Operations
Paul Soulos, Henry Conklin, Mattia Opper, Paul Smolensky, Jianfeng Gao, Roland Fernandez
- NeurIPS 2024 spotlight
- Readers: Everyone
Implicit Chain of Thought Reasoning via Knowledge Distillation
Yuntian Deng, Kiran Prasad, Roland Fernandez, Paul Smolensky, Vishrav Chaudhary, Stuart Shieber
- Submitted to ICLR 2024
- Readers: Everyone
Differentiable Tree Operations Promote Compositional Generalization
Paul Soulos, Edward J Hu, Kate McCurdy, Yunmo Chen, Roland Fernandez, Paul Smolensky, Jianfeng Gao
- Differentiable Almost Everything
- Readers: Everyone
Differentiable Tree Operations Promote Compositional Generalization
Paul Soulos, Edward J Hu, Kate McCurdy, Yunmo Chen, Roland Fernandez, Paul Smolensky, Jianfeng Gao
- ICML 2023 Poster
- Readers: Everyone
Predicting the Argumenthood of English Prepositional Phrases.
Najoung Kim, Kyle Rawlins, Benjamin Van Durme, Paul Smolensky
- 2019 (modified: 10 Nov 2022)
- AAAI2019
- Readers: Everyone
Question-Answering with Grammatically-Interpretable Representations
Hamid Palangi, Paul Smolensky, Xiaodong He, Li Deng
- 2018 (modified: 16 Jul 2019)
- AAAI 2018
- Readers: Everyone

View all 19 publications

Co-Authors

View all 27 co-authors