Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction

Object detection, while being an attractive interaction method for Augmented Reality (AR), is fundamentally error-prone due to the probabilistic nature of the underlying AI models, resulting in sub-optimal user experiences. In this paper, we explore the effect of three game design concepts, Ambiguit...

Full description

Saved in:
Bibliographic Details
Main Authors: KIM, Minji, LEE, Kyungjin, BALAN, Rajesh Krishna, LEE, Youngki
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2023
Subjects:
Online Access:https://ink.library.smu.edu.sg/sis_research/8652
https://ink.library.smu.edu.sg/context/sis_research/article/9655/viewcontent/3544548.3581270.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
id sg-smu-ink.sis_research-9655
record_format dspace
spelling sg-smu-ink.sis_research-96552024-02-22T03:08:22Z Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction KIM, Minji LEE, Kyungjin BALAN, Rajesh Krishna LEE, Youngki Object detection, while being an attractive interaction method for Augmented Reality (AR), is fundamentally error-prone due to the probabilistic nature of the underlying AI models, resulting in sub-optimal user experiences. In this paper, we explore the effect of three game design concepts, Ambiguity, Transparency, and Controllability, to provide better gameplay experiences in AR games that use error-prone object detection-based interaction modalities. First, we developed a base AR pet breeding game, called Bubbleu that uses object detection as a key interaction method. We then implemented three different variants, each according to the three concepts, to investigate the impact of each design concept on the overall user experience. Our user study results show that each design has its own strengths and can improve player experiences in different ways such as decreasing perceived errors (Ambiguity), explaining the system (Transparency), and enabling users to control the rate of uncertainties (Controllability). 2023-04-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/8652 info:doi/10.1145/3544548.3581270 https://ink.library.smu.edu.sg/context/sis_research/article/9655/viewcontent/3544548.3581270.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University computer vision vision sensing Human-AI Interaction Artificial Intelligence and Robotics Software Engineering
institution Singapore Management University
building SMU Libraries
continent Asia
country Singapore
Singapore
content_provider SMU Libraries
collection InK@SMU
language English
topic computer vision
vision sensing
Human-AI Interaction
Artificial Intelligence and Robotics
Software Engineering
spellingShingle computer vision
vision sensing
Human-AI Interaction
Artificial Intelligence and Robotics
Software Engineering
KIM, Minji
LEE, Kyungjin
BALAN, Rajesh Krishna
LEE, Youngki
Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction
description Object detection, while being an attractive interaction method for Augmented Reality (AR), is fundamentally error-prone due to the probabilistic nature of the underlying AI models, resulting in sub-optimal user experiences. In this paper, we explore the effect of three game design concepts, Ambiguity, Transparency, and Controllability, to provide better gameplay experiences in AR games that use error-prone object detection-based interaction modalities. First, we developed a base AR pet breeding game, called Bubbleu that uses object detection as a key interaction method. We then implemented three different variants, each according to the three concepts, to investigate the impact of each design concept on the overall user experience. Our user study results show that each design has its own strengths and can improve player experiences in different ways such as decreasing perceived errors (Ambiguity), explaining the system (Transparency), and enabling users to control the rate of uncertainties (Controllability).
format text
author KIM, Minji
LEE, Kyungjin
BALAN, Rajesh Krishna
LEE, Youngki
author_facet KIM, Minji
LEE, Kyungjin
BALAN, Rajesh Krishna
LEE, Youngki
author_sort KIM, Minji
title Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction
title_short Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction
title_full Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction
title_fullStr Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction
title_full_unstemmed Bubbleu: Exploring augmented reality game design with uncertain AI-based interaction
title_sort bubbleu: exploring augmented reality game design with uncertain ai-based interaction
publisher Institutional Knowledge at Singapore Management University
publishDate 2023
url https://ink.library.smu.edu.sg/sis_research/8652
https://ink.library.smu.edu.sg/context/sis_research/article/9655/viewcontent/3544548.3581270.pdf
_version_ 1794549705243361280