Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction
Object detection, while being an attractive interaction method for Augmented Reality (AR), is fundamentally error-prone due to the probabilistic nature of the underlying AI models, resulting in sub-optimal user experiences. In this paper, we explore the effect of three game design concepts, Ambiguit...
Saved in:
Main Authors: | , , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2023
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/8652 https://ink.library.smu.edu.sg/context/sis_research/article/9655/viewcontent/3544548.3581270.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-9655 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-96552024-02-22T03:08:22Z Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction KIM, Minji LEE, Kyungjin BALAN, Rajesh Krishna LEE, Youngki Object detection, while being an attractive interaction method for Augmented Reality (AR), is fundamentally error-prone due to the probabilistic nature of the underlying AI models, resulting in sub-optimal user experiences. In this paper, we explore the effect of three game design concepts, Ambiguity, Transparency, and Controllability, to provide better gameplay experiences in AR games that use error-prone object detection-based interaction modalities. First, we developed a base AR pet breeding game, called Bubbleu that uses object detection as a key interaction method. We then implemented three different variants, each according to the three concepts, to investigate the impact of each design concept on the overall user experience. Our user study results show that each design has its own strengths and can improve player experiences in different ways such as decreasing perceived errors (Ambiguity), explaining the system (Transparency), and enabling users to control the rate of uncertainties (Controllability). 2023-04-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/8652 info:doi/10.1145/3544548.3581270 https://ink.library.smu.edu.sg/context/sis_research/article/9655/viewcontent/3544548.3581270.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University computer vision vision sensing Human-AI Interaction Artificial Intelligence and Robotics Software Engineering |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
computer vision vision sensing Human-AI Interaction Artificial Intelligence and Robotics Software Engineering |
spellingShingle |
computer vision vision sensing Human-AI Interaction Artificial Intelligence and Robotics Software Engineering KIM, Minji LEE, Kyungjin BALAN, Rajesh Krishna LEE, Youngki Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction |
description |
Object detection, while being an attractive interaction method for Augmented Reality (AR), is fundamentally error-prone due to the probabilistic nature of the underlying AI models, resulting in sub-optimal user experiences. In this paper, we explore the effect of three game design concepts, Ambiguity, Transparency, and Controllability, to provide better gameplay experiences in AR games that use error-prone object detection-based interaction modalities. First, we developed a base AR pet breeding game, called Bubbleu that uses object detection as a key interaction method. We then implemented three different variants, each according to the three concepts, to investigate the impact of each design concept on the overall user experience. Our user study results show that each design has its own strengths and can improve player experiences in different ways such as decreasing perceived errors (Ambiguity), explaining the system (Transparency), and enabling users to control the rate of uncertainties (Controllability). |
format |
text |
author |
KIM, Minji LEE, Kyungjin BALAN, Rajesh Krishna LEE, Youngki |
author_facet |
KIM, Minji LEE, Kyungjin BALAN, Rajesh Krishna LEE, Youngki |
author_sort |
KIM, Minji |
title |
Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction |
title_short |
Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction |
title_full |
Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction |
title_fullStr |
Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction |
title_full_unstemmed |
Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction |
title_sort |
bubbleu: exploring augmented reality game design with uncertain ai-based interaction |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2023 |
url |
https://ink.library.smu.edu.sg/sis_research/8652 https://ink.library.smu.edu.sg/context/sis_research/article/9655/viewcontent/3544548.3581270.pdf |
_version_ |
1794549705243361280 |