【学术讲座】基于人工智能的工作流程设计：人工智能建议的提供时机对医疗诊断决策的影响

Designing AI-Based Work Processes: The Impact of AI Advice Provision Timing on Medical Diagnosis Decisions

讲座信息 | INFOMATION

讲者：Prof. Teo Hock Hai (National University of Singapore)

时间：2024年12月23日（周一） 14时

地点:   同济大厦A座402教室

讲座摘要 | ABSTRACT

While clinical artificial intelligence (AI) systems can potentially augment medical diagnoses by providing competent second opinions, little is known about how to effectively deploy AI into routine diagnostic processes, such as when to present AI advice to human physicians. This research addresses this critical question by experimentally examining the impact of AI advice provision timing on medical diagnosis decisions using a think-aloud approach. Specifically, physician participants provided differential diagnoses and confidence assessments under one of three conditions: ex-post advice condition (participants obtained AI advice after making an initial diagnosis), ex-ante advice condition (participants processed clinical information and AI advice concurrently), or control condition (participants were not exposed to AI advice). Results show that AI advice provision timing has a significant impact on diagnostic accuracy and calibration, with the ex-post advice condition showing the best performance and the control condition the worst. Further analysis of the mechanism reveals that participants in the ex-post advice condition perform more extensive clinical information processing and engage more deeply with AI’s reasoning rationale. They are more likely to reap benefits from disconfirming AI advice, particularly when they agree with its underlying reasoning rationale. We further estimate the heterogeneous treatment effects based on physician and clinical case characteristics. Overall, our results suggest that presenting AI advice at an appropriate timing in routine diagnostic processes is crucial to successful decision augmentation.

Key Words: artificial intelligence, human-in-the-loop, work design, anchoring, information processing, advice taking, medical decision-making, verbal protocol analysis

讲者介绍 | GUEST BIO

Hock-Hai Teo is Provost's Chair Professor of Information Systems. He served as the Head of the Department of Information Systems at the School of Computing, National University of Singapore from August 2008 to June 2015 and as Vice-Dean, Corporate Communications from August 2007 to August 2008. His current research interests focus mainly on Health Informatics, open innovation, and IT artifacts that are geared towards improving individual decision-making, health outcomes and educational outcomes. Dr. Teo has published broadly in journals such as the ACM Transactions on Computer-Human Interactions, MIS Quarterly, Journal of Management Information Systems, Information Systems Research, IEEE Transactions on Engineering Management, International Journal of Human-Computer Studies, and Information and Management and has presented at numerous international conferences, including the International Conference on Information Systems. He is currently serving or has served on the editorial boards of Data Base for Advances in Information Systems, European Journal of Information Systems, International Journal of Electronic Commerce, Information Systems Research, IEEE Transactions on Engineering Management and MIS Quarterly. He has won numerous best paper award at conferences and was also the winner of the MIS Quarterly Reviewer of the Year (2004) award.