Clause complexing in research-article abstracts: comparing human- and AI-generated texts

The ability of chatbots to produce plausible, human-like responses raises questions about the extent of their similarity with original texts. Using a modified version of Halliday’s clause-complexing framework, this study compared 50 abstracts of scientific research articles from Nature with generate...

Full description

Saved in:
Bibliographic Details
Main Author: Leong, Alvin Ping
Other Authors: School of Humanities
Format: Article
Language:English
Published: 2024
Subjects:
Online Access:https://hdl.handle.net/10356/172988
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-172988
record_format dspace
spelling sg-ntu-dr.10356-1729882024-01-13T16:56:54Z Clause complexing in research-article abstracts: comparing human- and AI-generated texts Leong, Alvin Ping School of Humanities Humanities::Language Clause Complexing Generative AI The ability of chatbots to produce plausible, human-like responses raises questions about the extent of their similarity with original texts. Using a modified version of Halliday’s clause-complexing framework, this study compared 50 abstracts of scientific research articles from Nature with generated versions produced by Bard, ChatGPT, and Poe Assistant. None of the chatbots matched the original abstracts in all categories. The only chatbot that came closest was ChatGPT, but differences in the use of finite adverbial clauses and –ing elaborating clauses were detected. Incorporating distinct grammatical features in the algorithms of AI-detection tools is crucially needed to enhance the reliability of their results. A genre-based approach to detecting AI-generated content is recommended. Published version 2024-01-08T02:30:24Z 2024-01-08T02:30:24Z 2023 Journal Article Leong, A. P. (2023). Clause complexing in research-article abstracts: comparing human- and AI-generated texts. ExELL, 11(2), 99-132. https://dx.doi.org/10.2478/exell-2023-0008 2303-4858 https://hdl.handle.net/10356/172988 10.2478/exell-2023-0008 2-s2.0-85179826581 2 11 99 132 en ExELL © The Author. This is an open-access article distributed under the terms of the Creative Commons License. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Humanities::Language
Clause Complexing
Generative AI
spellingShingle Humanities::Language
Clause Complexing
Generative AI
Leong, Alvin Ping
Clause complexing in research-article abstracts: comparing human- and AI-generated texts
description The ability of chatbots to produce plausible, human-like responses raises questions about the extent of their similarity with original texts. Using a modified version of Halliday’s clause-complexing framework, this study compared 50 abstracts of scientific research articles from Nature with generated versions produced by Bard, ChatGPT, and Poe Assistant. None of the chatbots matched the original abstracts in all categories. The only chatbot that came closest was ChatGPT, but differences in the use of finite adverbial clauses and –ing elaborating clauses were detected. Incorporating distinct grammatical features in the algorithms of AI-detection tools is crucially needed to enhance the reliability of their results. A genre-based approach to detecting AI-generated content is recommended.
author2 School of Humanities
author_facet School of Humanities
Leong, Alvin Ping
format Article
author Leong, Alvin Ping
author_sort Leong, Alvin Ping
title Clause complexing in research-article abstracts: comparing human- and AI-generated texts
title_short Clause complexing in research-article abstracts: comparing human- and AI-generated texts
title_full Clause complexing in research-article abstracts: comparing human- and AI-generated texts
title_fullStr Clause complexing in research-article abstracts: comparing human- and AI-generated texts
title_full_unstemmed Clause complexing in research-article abstracts: comparing human- and AI-generated texts
title_sort clause complexing in research-article abstracts: comparing human- and ai-generated texts
publishDate 2024
url https://hdl.handle.net/10356/172988
_version_ 1789483069945675776