Clause complexing in research-article abstracts: comparing human- and AI-generated texts
The ability of chatbots to produce plausible, human-like responses raises questions about the extent of their similarity with original texts. Using a modified version of Halliday’s clause-complexing framework, this study compared 50 abstracts of scientific research articles from Nature with generate...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2024
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/172988 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-172988 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1729882024-01-13T16:56:54Z Clause complexing in research-article abstracts: comparing human- and AI-generated texts Leong, Alvin Ping School of Humanities Humanities::Language Clause Complexing Generative AI The ability of chatbots to produce plausible, human-like responses raises questions about the extent of their similarity with original texts. Using a modified version of Halliday’s clause-complexing framework, this study compared 50 abstracts of scientific research articles from Nature with generated versions produced by Bard, ChatGPT, and Poe Assistant. None of the chatbots matched the original abstracts in all categories. The only chatbot that came closest was ChatGPT, but differences in the use of finite adverbial clauses and –ing elaborating clauses were detected. Incorporating distinct grammatical features in the algorithms of AI-detection tools is crucially needed to enhance the reliability of their results. A genre-based approach to detecting AI-generated content is recommended. Published version 2024-01-08T02:30:24Z 2024-01-08T02:30:24Z 2023 Journal Article Leong, A. P. (2023). Clause complexing in research-article abstracts: comparing human- and AI-generated texts. ExELL, 11(2), 99-132. https://dx.doi.org/10.2478/exell-2023-0008 2303-4858 https://hdl.handle.net/10356/172988 10.2478/exell-2023-0008 2-s2.0-85179826581 2 11 99 132 en ExELL © The Author. This is an open-access article distributed under the terms of the Creative Commons License. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Humanities::Language Clause Complexing Generative AI |
spellingShingle |
Humanities::Language Clause Complexing Generative AI Leong, Alvin Ping Clause complexing in research-article abstracts: comparing human- and AI-generated texts |
description |
The ability of chatbots to produce plausible, human-like responses raises questions about the extent of their similarity with original texts. Using a modified version of Halliday’s clause-complexing framework, this study compared 50 abstracts of scientific research articles from Nature with generated versions produced by Bard, ChatGPT, and Poe Assistant. None of the chatbots matched the original abstracts in all categories. The only chatbot that came closest was ChatGPT, but differences in the use of finite adverbial clauses and –ing elaborating clauses were detected. Incorporating distinct grammatical features in the algorithms of AI-detection tools is crucially needed to enhance the reliability of their results. A genre-based approach to detecting AI-generated content is recommended. |
author2 |
School of Humanities |
author_facet |
School of Humanities Leong, Alvin Ping |
format |
Article |
author |
Leong, Alvin Ping |
author_sort |
Leong, Alvin Ping |
title |
Clause complexing in research-article abstracts: comparing human- and AI-generated texts |
title_short |
Clause complexing in research-article abstracts: comparing human- and AI-generated texts |
title_full |
Clause complexing in research-article abstracts: comparing human- and AI-generated texts |
title_fullStr |
Clause complexing in research-article abstracts: comparing human- and AI-generated texts |
title_full_unstemmed |
Clause complexing in research-article abstracts: comparing human- and AI-generated texts |
title_sort |
clause complexing in research-article abstracts: comparing human- and ai-generated texts |
publishDate |
2024 |
url |
https://hdl.handle.net/10356/172988 |
_version_ |
1789483069945675776 |