Press E.S.C. and Enter the Makerspace: An Assessment of AI Tools in Reviewing Makerspace Literature

• Main Authors: Factor, Marvin, Cruz, Kate Lora
• Format: text
• Published: Animo Repository 2024
• Online Access: https://animorepository.dlsu.edu.ph/conf_dlsplc/2024/schedule/11
• Institution: De La Salle University

ABSTRACT Purpose/objectives. As part of the academic research community. The authors share the sentiments of other researchers that conducting a literature review and coming up with a matrix is a cumbersome task. The development of research tools that benefit researchers in the conduct of their study is always interesting and welcome. Thus, the objectives of this study are: (1) To evaluate the features and functionalities of Elicit, SciSpace, and Consensus in facilitating literature review and research and recommend the applicability of each tool for a type of research; (2) Assess and identify the strengths of these tools and align the impact with research workflows and efficiency; and (3) Utilize documented user feedback and opinions to ensure the appropriate AI tool is available for the researchers. Design, methodology, approach. This study adopts a mixed-methods approach. Firstly, a systematic literature review is conducted to gather relevant studies, user feedback, and expert opinions on the AI tools. These same studies will be used as the sample variables for this study. Secondly, a comparative check on each AI tool against each other and the original document is administered to evaluate each tool against the set evaluation criteria, which includes search capabilities, document retrieval, summarization accuracy, citation analysis, and integration with existing research workflows. Lastly, identify the strengths and weaknesses of each tool against the criteria and determine the effectiveness of the AI tool based on the original content of the sample material. Findings. The findings of this study include (a) Identified AI tools, such as Elicit, Scispace, and Consensus, which offer valuable contributions to the research community through productivity-boosting features.; (b) Each tool has strengths and weaknesses in search capabilities, document retrieval, summarization accuracy, citation analysis, and integration with existing research workflows; and (c) Documented user feedback indicates positive experiences with the usability and effectiveness of the tools, highlighting their potential to enhance research workflows. Research limitations and implications. This study acknowledges potential limitations, including the reliance on user feedback and the subjective nature of user experiences. The evaluation is based on a specific set of criteria, and the results may vary depending on individual research needs and preferences. This study provides practical implications for researchers, students, and professionals seeking efficient and effective literature review tools. Elicit, Scispace, and Consensus offer insights into their strengths, weaknesses, and potential applications. The findings contribute to informed decision-making regarding adopting and utilizing these AI tools in research. Originality of the paper: This study examines AI tools specifically designed for conducting literature reviews, distinguishing itself from existing research that predominantly emphasizes the application of AI in academic research settings. It offers an analysis of how various AI features can enhance the literature review process, thereby contributing a unique perspective to the ongoing discourse on the integration of AI in research methodologies. Keywords: AI tools, Literature review, research tools, Elicit, SciSpace, and Consensus