Ground Truth Bias in AI-Assisted Medical Annotation: A Crossover Study Using an Independent Radiologist Reference Standard
Márton Baltay, Tamás Ilcsik, Márton Borbély
Abstract
Behavioural evaluations of artificial-intelligence-assisted annotation score every human decision against a reference standard, so their conclusions inherit that standard's validity. We tested how far conclusions about assistance, reliance and individual differences depend on it. Fifty-one non-expert high-school students annotated 50 knee radiographs for osteoarthritis, with and without a deliberately imperfect classifier, in a crossover design; personality and non-verbal reasoning were also measured. Decisions were scored against the public repository labels and against an independent reference standard from a radiologist panel, which graded 23 of the 50 images as indeterminate. Against the repository labels, assistance raised accuracy from 60.4% to 65.3% (odds ratio 1.23, p=0.002). Against the independent standard, the gain on the 27 determinate images was smaller and not significant in the primary model (78.4% to 80.8%; odds ratio 1.16, p=0.178). The apparent benefit had been concentrated on the indeterminate images and was not significant when those images were assigned to either class. The direction of residual over-reliance depended on how indeterminate cases were handled, and the personality trait most strongly associated with accuracy changed identity and sign between standards. Reliance measures are only as valid as the reference standard that defines when the assistant is right.
Create a lesson
Related papers
Introducing ReTiNA-Cinema: Real-Time Neuro-Augmented Cinema via Generative AI
Antoine Bellemare-Pepin, Philipp Thölke, Yann Harel et al.
Rethinking Utility in Differentially Private Visualization: A Channel-Centric Perspective
Jing Yang, Sarayu Pacca, Zhaocong Yang et al.
Presenting Your Figures: Data-informed Animated Transitions Across Scientific Figure Panels
Lu Ying, Can Liu, Yuxiao Yang et al.
Embodied Human-Data Interaction
Niklas Elmqvist
From Reliance to Overreliance: Taxonomizing and Detecting Relational Risks in AI Companionship
Viet Cuong Nguyen, Fiona Li, Chang Wan et al.
GenAI-DBT: Evaluating a DBT-Informed Generative AI Platform for Mindfulness Skills Training: A Pilot Randomized Study
Jingchen Ye, Yujia Chen, Leyang Han et al.