COLM 2025 Workshop NLPOR Submissions

AIn’t Nothing But a Survey? Using Large Language Models for Coding German Open-Ended Survey Responses on Survey Motivation
Leah von der Heyde, Anna-Carolina Haensch, Bernd Weiß, Jessica Daikeler
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Who Counts? The Potentials and Pitfalls of Using LLMs in Survey Research
Leah von der Heyde
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
In-Context Learning for the Imputation of Survey Data
Tobias Holtdirk, Georg Ahnert, Anna-Carolina Haensch
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Mic Drop or Data Flop? Evaluating the Fitness for Purpose of AI Voice Interviewers for Data Collection within Quantitative & Qualitative Research Contexts
Shreyas Tirumala, Nishant Jain, Danny D. Leybzon, Trent D Buskirk
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
In Your Own Words: Free-Text Descriptions of Identity Reveal Information Beyond Census Categories
Jenny Shan Wang, Emma Pierson
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Exploring Side-by-Side LLM Evaluation Through Human Alignment and Bias Mitigation
Kseniia Titova, Darina Rustamova, Alan-Barsag Gazzaev, Maksim Polushin, Valentin Malykh, Sergey Zagoruyko
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
SAI What?! Ping the Bots Before You Probe the People: Testing Large Language Models for Pre-Cognitive Interviewing in Survey Research
Trent D Buskirk, Darby Steiger, Courtney Kennedy
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Cross-corpora argument analysis using textual entailment
Algis Petlin, Sue-Ellen Duffy, Ankita Gupta, Brendan O'Connor
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Beyond Consensus: Use of Demographics for Datasets that Reflect Annotator Disagreement
Narjes Tahaei, Sabine Bergler
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Evaluating the Human-Likeness of LLM-Generated Open-Ended Responses
Joshua Y. Lerner, Brandon Sepulvado, Lilian Huang, Soubhik Barari
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Uncovering Hidden Factions through Text-Network Representations: Unsupervised Public Opinion Mapping of Iran on Twitter in the 2022 Unrest
Sahar Omidi Shayegan, Jean-François Godbout, Reihaneh Rabbany
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
More Parameters Than Populations: A Systematic Review of Large Language Models in Survey Research
Trent D Buskirk, Florian Keusch, Leah von der Heyde, Adam Eck
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
LLM-Enhanced Survey Methodology: Validation, Automation, and Mixed Methods at Scale
Les DeBusk-Lane, Anirban Pal
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Beyond Accuracy: A Replication Fidelity Framework for Trustworthy LLM Evaluation in Social Science Applications
Chen Peng, Samridh Aggarwal, Arnstein Aassve, Lorenzo Lupo, Nicolò Cavalli
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Linking Survey and Social Media Data: Natural Language Processing for Bridging the Gap Between Open Access and Data Protection
Conor Gaughan, Rachel Gibson, Alexandru Cernat, Marta Cantijoch, Riza Batista-Navarro
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Back to the basics and to the future: Evaluating silicon samples with POR standards
Yongwei Yang, Gina Walejko
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
[Work-in-Progress] Multi-Instance Learning for Social Media- Based Spatiotemporal Public Opinion Analysis
Shanshan Bai, Anna Kruspe, Xiao Xiang Zhu
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Position: Insights from Survey Methodology can Improve Training Data
Stephanie Eckman, Barbara Plank, Frauke Kreuter
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Annotation Sensitivity: Training Data Collection Methods Affect Model Performance
Christoph Kern, Stephanie Eckman, Jacob Beck, Bolei Ma, Rob Chew, Frauke Kreuter
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Using Large Language Models to measure and classify occupations in surveys
Patrick Sturgis, Tom, Laura Feng, Caroline Roberts
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Understanding Public Opinion through Social Media: Summarization, Stance Annotation, Demographic Inference
Frederick Conrad, Michael Schober, Rebecca S. Dolgin, Mao Li, Peilin Chen, Erik Zhou
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviors
Tiancheng Hu, Joachim Baumann, Lorenzo Lupo, Nigel Collier, Dirk Hovy, Paul Röttger
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinions
Joseph Suh, Erfan Jahanparast, Suhong Moon, Minwoo Kang, Serina Chang
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone
Social sciences and AI joining forces: towards new approaches for computational social sciences
Katharina Soemer, Daniela Grunow, Steffen Eger
- Published: 26 Jul 2025, Last Modified: 06 Oct 2025
- NLPOR 2025
- Readers: Everyone