Interactive example-based explanations to improve health professionals’ onboarding with AI for human-AI collaborative decision making
A growing research explores the usage of AI explanations on user’s decision phases for human-AI collaborative decision-making. However, previous studies found the issues of overreliance on ‘wrong’ AI outputs. In this paper, we propose interactive example-based explanations to improve health professi...
Saved in:
Main Authors: | , , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2024
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/9689 https://ink.library.smu.edu.sg/context/sis_research/article/10689/viewcontent/FAIA_392_FAIA241044.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-10689 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-106892024-11-28T09:09:48Z Interactive example-based explanations to improve health professionals’ onboarding with AI for human-AI collaborative decision making LEE, Min Hun NG, Renee Bao Xuan CHOO, Silvana Xinyi THILARAJAH, Shamala A growing research explores the usage of AI explanations on user’s decision phases for human-AI collaborative decision-making. However, previous studies found the issues of overreliance on ‘wrong’ AI outputs. In this paper, we propose interactive example-based explanations to improve health professionals’ onboarding with AI for their better reliance on AI during AI-assisted decision-making. We implemented an AI-based decision support system that utilizes a neural network to assess the quality of post-stroke survivors’ exercises and interactive example-based explanations that systematically surface the nearest neighborhoods of a test/task sample from the training set of the AI model to assist users’ onboarding with the AI model. To investigate the effect of interactive example-based explanations, we conducted a study with domain experts, health professionals to evaluate their performance and reliance on AI. Our interactive example-based explanations during onboarding assisted health professionals in having a better reliance on AI and making a higher ratio of making ‘right’ decisions and a lower ratio of ‘wrong’ decisions than providing only feature-based explanations during the decision-support phase. Our study discusses new challenges of assisting user’s onboarding with AI for human-AI collaborative decision-making. 2024-10-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/9689 info:doi/10.3233/FAIA241044 https://ink.library.smu.edu.sg/context/sis_research/article/10689/viewcontent/FAIA_392_FAIA241044.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Human-AI collaborative decision-making AI assisted decision-making Decision support system Example-based explanations Artificial Intelligence and Robotics |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
Human-AI collaborative decision-making AI assisted decision-making Decision support system Example-based explanations Artificial Intelligence and Robotics |
spellingShingle |
Human-AI collaborative decision-making AI assisted decision-making Decision support system Example-based explanations Artificial Intelligence and Robotics LEE, Min Hun NG, Renee Bao Xuan CHOO, Silvana Xinyi THILARAJAH, Shamala Interactive example-based explanations to improve health professionals’ onboarding with AI for human-AI collaborative decision making |
description |
A growing research explores the usage of AI explanations on user’s decision phases for human-AI collaborative decision-making. However, previous studies found the issues of overreliance on ‘wrong’ AI outputs. In this paper, we propose interactive example-based explanations to improve health professionals’ onboarding with AI for their better reliance on AI during AI-assisted decision-making. We implemented an AI-based decision support system that utilizes a neural network to assess the quality of post-stroke survivors’ exercises and interactive example-based explanations that systematically surface the nearest neighborhoods of a test/task sample from the training set of the AI model to assist users’ onboarding with the AI model. To investigate the effect of interactive example-based explanations, we conducted a study with domain experts, health professionals to evaluate their performance and reliance on AI. Our interactive example-based explanations during onboarding assisted health professionals in having a better reliance on AI and making a higher ratio of making ‘right’ decisions and a lower ratio of ‘wrong’ decisions than providing only feature-based explanations during the decision-support phase. Our study discusses new challenges of assisting user’s onboarding with AI for human-AI collaborative decision-making. |
format |
text |
author |
LEE, Min Hun NG, Renee Bao Xuan CHOO, Silvana Xinyi THILARAJAH, Shamala |
author_facet |
LEE, Min Hun NG, Renee Bao Xuan CHOO, Silvana Xinyi THILARAJAH, Shamala |
author_sort |
LEE, Min Hun |
title |
Interactive example-based explanations to improve health professionals’ onboarding with AI for human-AI collaborative decision making |
title_short |
Interactive example-based explanations to improve health professionals’ onboarding with AI for human-AI collaborative decision making |
title_full |
Interactive example-based explanations to improve health professionals’ onboarding with AI for human-AI collaborative decision making |
title_fullStr |
Interactive example-based explanations to improve health professionals’ onboarding with AI for human-AI collaborative decision making |
title_full_unstemmed |
Interactive example-based explanations to improve health professionals’ onboarding with AI for human-AI collaborative decision making |
title_sort |
interactive example-based explanations to improve health professionals’ onboarding with ai for human-ai collaborative decision making |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2024 |
url |
https://ink.library.smu.edu.sg/sis_research/9689 https://ink.library.smu.edu.sg/context/sis_research/article/10689/viewcontent/FAIA_392_FAIA241044.pdf |
_version_ |
1819113103571288064 |