Triage Score: A Counterfactual Risk Assessment Instrument (SIMONS-ECON)
39:56LLM-Guided Reinforcement Learning for Mastery Learning: Large-Scale Field Evidence (SIMONS-ECON)
35:06Non-parametric Causal Inference in Dynamic Thresholding Designs (SIMONS-ECON)
30:21Agreement and Alignment for Human-AI Collaborative Decision Making (SIMONS-ECON)
45:21Human Values in Clinical Algorithms, Old and New (SIMONS-ECON)
38:46When Prediction Becomes Policy: What Do Risk Models Actually Learn? (SIMONS-ECON)
33:31Evaluating Probabilistic Decision Making by LLMs: A Decision-Theoretic Framework and Application (SIMONS-ECON)
32:16Algorithmic UDAP (SIMONS-ECON)
32:13Operational Dosage: The Impact of Capacity Constraints on RCT Evaluation (SIMONS-ECON)
35:01The Role of Standardized Tests in Admissions: Predictions vs. Decisions (SIMONS-ECON)
33:37Individual Gaps in Prediction Generalization (SIMONS-ECON)
30:41Beyond Prediction Performance: How Modeling Decisions Shape Fairness Outcomes in Statistical Profiling (SIMONS-ECON)
27:56The Feedback Loop of Statistical Discrimination (SIMONS-ECON)
32:03Decision Theoretic Foundations for Human-AI Collaboration (SIMONS-ECON)
31:01Evaluation Design (SIMONS-ECON)
29:16Recommendation in Equilibrium for the NYC High School Match (SIMONS-ECON)
32:51Automating the US Welfare State: Historical Experiments in Technological Federalism (SIMONS-ECON)
35:41On Machine Learning for Prediction and Prioritization in the Allocation of Scarce Societal Resources (SIMONS-ECON)
35:26The Feedback Loop of Statistical Discrimination (SIMONS-ECON)
This lecture introduces a dynamic model of firm-applicant interactions to identify mechanisms driving long-term statistical discrimination, highlighting the role of initial evaluation ability.
Jackie Baek (NYU Stern)
Bridging Prediction and Intervention Problems in Social Systems
We study a dynamic model of interactions between a firm and job applicants to identify mechanisms that drive long-term discrimination. In each round, the firm decides which applicants to hire, where the firm's ability to evaluate applicants is imperfect. Each applicant belongs to a group, and central to our model is the idea that the firm becomes better at evaluating applicants from groups in which they have hired from in the recent past. We establish the firm's initial evaluation ability for each group to be a critical factor in determining long-term outcomes. We show that there is a threshold for which if the firm's initial evaluation ability for the group is below the threshold, the group's hiring rate decreases over time and eventually goes to zero. If the group starts above the threshold, then the hiring rate stabilizes to a positive constant. Therefore, even when two groups are identical in size and underlying skill distribution, a marginal difference in the firm's initial evaluation ability can lead to persistent disparities that exacerbate over time through a feedback loop. Importantly, the dynamic nature of our model allows us to assess the long-term impact of interventions, specifically, whether an improvement is sustained even after the intervention is lifted. In this light, we show that drastic short-term interventions are more effective compared to milder long-term interventions. Additionally, we show that smaller groups face inherent disadvantages, requiring a higher initial evaluation ability to achieve a favorable long-term hiring outcome and experiencing lower hiring rates even when they do.
Beyond Prediction Performance: How Modeling Decisions Shape Fairness Outcomes in Statistical Profiling (SIMONS-ECON)
Next · Lecture 14Decision Theoretic Foundations for Human-AI Collaboration (SIMONS-ECON)
