Vision-based tangible maths tutor

Object detection techniques have been improving over the past several years and they have seen many applications in various domains. However, the early childhood education domain is one that has been relatively unexplored. This project contributes by exploring the use of object detection in early ch...

Full description

Saved in:
Bibliographic Details
Main Author: Toh, Jun Wei
Other Authors: Goh Wooi Boon
Format: Final Year Project
Language:English
Published: Nanyang Technological University 2022
Subjects:
Online Access:https://hdl.handle.net/10356/162843
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-162843
record_format dspace
spelling sg-ntu-dr.10356-1628432022-11-11T01:06:37Z Vision-based tangible maths tutor Toh, Jun Wei Goh Wooi Boon School of Computer Science and Engineering ASWBGOH@ntu.edu.sg Engineering::Computer science and engineering Object detection techniques have been improving over the past several years and they have seen many applications in various domains. However, the early childhood education domain is one that has been relatively unexplored. This project contributes by exploring the use of object detection in early childhood education. A tangible user interface-based learning system was developed for young children to learn mathematics from. The system, called VTMT, uses a set of tangible manipulatives for interacting with the system. A YOLOv4-tiny object detection model was trained to detect these tangible manipulatives and deployed in a mobile application. The model was able to achieve a very high accuracy of more than 95%, thus ensuring the reliability of the system for learning. The mobile application serves as a tutor, recognising the manipulatives children had placed in a work area and providing relevant auditory feedback. Exploratory-based, practice-based, and assessment-based activities were developed as part of the learning activities of the system. Multiple ways of interacting with the system using the tangible manipulatives were implemented. Such methods differed in (1) the use of special manipulatives for controlling the system and (2) the main tangible manipulatives used for learning. An informal user study was conducted with the primary objective of determining the usability of each method. Results from the user study showed no clear preference in the different usages of the special manipulatives, while participants generally favoured using numbers as the main tangible manipulatives. Bachelor of Engineering (Computer Science) 2022-11-11T01:06:37Z 2022-11-11T01:06:37Z 2022 Final Year Project (FYP) Toh, J. W. (2022). Vision-based tangible maths tutor. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/162843 https://hdl.handle.net/10356/162843 en application/pdf Nanyang Technological University
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering
spellingShingle Engineering::Computer science and engineering
Toh, Jun Wei
Vision-based tangible maths tutor
description Object detection techniques have been improving over the past several years and they have seen many applications in various domains. However, the early childhood education domain is one that has been relatively unexplored. This project contributes by exploring the use of object detection in early childhood education. A tangible user interface-based learning system was developed for young children to learn mathematics from. The system, called VTMT, uses a set of tangible manipulatives for interacting with the system. A YOLOv4-tiny object detection model was trained to detect these tangible manipulatives and deployed in a mobile application. The model was able to achieve a very high accuracy of more than 95%, thus ensuring the reliability of the system for learning. The mobile application serves as a tutor, recognising the manipulatives children had placed in a work area and providing relevant auditory feedback. Exploratory-based, practice-based, and assessment-based activities were developed as part of the learning activities of the system. Multiple ways of interacting with the system using the tangible manipulatives were implemented. Such methods differed in (1) the use of special manipulatives for controlling the system and (2) the main tangible manipulatives used for learning. An informal user study was conducted with the primary objective of determining the usability of each method. Results from the user study showed no clear preference in the different usages of the special manipulatives, while participants generally favoured using numbers as the main tangible manipulatives.
author2 Goh Wooi Boon
author_facet Goh Wooi Boon
Toh, Jun Wei
format Final Year Project
author Toh, Jun Wei
author_sort Toh, Jun Wei
title Vision-based tangible maths tutor
title_short Vision-based tangible maths tutor
title_full Vision-based tangible maths tutor
title_fullStr Vision-based tangible maths tutor
title_full_unstemmed Vision-based tangible maths tutor
title_sort vision-based tangible maths tutor
publisher Nanyang Technological University
publishDate 2022
url https://hdl.handle.net/10356/162843
_version_ 1751548576703447040