AI evaluation
For teams shipping systems that make claims about people.
- Dataset and benchmark design and collection
- Model evaluation
- Generative psychometrics
Psychology · Measurement · Machine learning
Jeff Girard
I work where psychological measurement meets machine learning. I build datasets, benchmarks and evaluations for systems that make claims about human behavior.
Associate Professor of Psychology at the University of Kansas, where I direct the Affective Communication & Computing Lab
About
I trained as a clinical psychologist (PhD, University of Pittsburgh, 2018), and my research is about measuring things that resist measurement: emotion, clinical state, the texture of a conversation. That work has appeared in Annual Review of Clinical Psychology, Journal of Consulting and Clinical Psychology and Affective Science, and it has produced open-source tools that other researchers use.
Through Girard Consulting I bring the same standards to applied work for teams building systems that reason about people. The research itself, and the students and staff who do it with me, live at the AffCom Lab.
- Associate Professor of Psychology and Data Science University of Kansas
- Director Affective Communication and Computing Lab
- Principal Scientist Fluid Concepts Research
- Co-founder SMaRT Workshops
Work with me
Measurement and statistics
For work that has to survive review.
- Instrument development and validation
- Inter-rater reliability and psychometrics
- Study design and statistical analysis
Tooling and training
For teams who want the capability in-house.
- R package and pipeline development
- Workshops and methods training
Tell me what you are trying to measure, and what would count as getting it right.
Selected papers
- Sentiment Analysis of Naturalistic Speech Using Open-Weight Large Language Models
- Computational Analysis of Expressive Behavior in Clinical Assessment
- Dynamic and Dyadic Relationships between Facial Behavior, Working Alliance, and Treatment Outcomes during Depression Therapy
- DynAMoS: The Dynamic Affective Movie Clip Database for Subjectivity Analysis
- Reconsidering the Duchenne Smile: Formalizing and Testing Hypotheses about Eye Constriction and Positive Emotion
More at the lab
- Publications
All 72, with preprints, data and code where they exist.
- Datasets and benchmarks
Corpora and benchmarks from the lab, and how to get them.
- Software and courses
R packages, research tools and open course materials.