ReCo.ai: Using Generative Pre-trained Transformer 3 Model for a Chatbot in Answering Grade 10 Mathematics Questions

• Main Authors: Amado, Prince Travis S., Delos Santos, Lhord Cedrick T., Germino, Misxa Bien D., Nolo, Aaron Gabriel G., Fronteras, Vincent Ace C., Tria, Robyn Lauren C., Congreso, Kent Patrick T., Oriol, Dalziel
• Format: text
• Published: Animo Repository 2023
• Subjects: artificial intelligence; machine learning, chatbot, mathematics, natural language processing
• Online Access: https://animorepository.dlsu.edu.ph/conf_shsrescon/2023/paper_csr/2; https://animorepository.dlsu.edu.ph/context/conf_shsrescon/article/1800/viewcontent/PP_CSR_Amado_Congreso_Delos_Santos_Fronteras_Germino_Nolos_Oriol_Tria___AMADO__Prince_Travis_S..docx.pdf
• Institution: De La Salle University

Over the years, several studies have explored AI's ability in terms of education. This study aims to investigate how ReCo.ai performs in terms of accuracy in answering mathematical concepts about Grade 10 Mathematics. Using the Generative Pre-trained Transformer 3 (GPT-3) model to create a chatbot specifically within the grade 10 Mathematics curriculum, and used the GPT-3 Generated Text dataset for machine learning and natural language processing. The researchers tested the accuracy by evaluating its accuracy, precision and recall, and F1 score. F1 score test was used as a performance metric to evaluate the precision and recall of the chatbot's responses. Furthermore, the researchers analyzed the collected data using Descriptive Statistics (mean and standard deviation). With an accuracy of 61.6% (50-item test) and 78% (10-item test) showed a promising potential for use in educational settings. However, the consistency of accuracy may vary between the topics. This study shows that the chatbot has significant potential for answering grade 10 Mathematics questions, but further research is required to improve its performance and apply it in an actual learning environment. The results of this study have the potential to contribute to the development of intelligent tutoring systems and personalized education technology that can enhance the students' learning experiences in Mathematics and beyond.