Article Sidebar

Submitted
December 22, 2024
Published
August 31, 2025
Download
PDF
Statistic
Read Counter : 59 Download : 18

Downloads

Download data is not yet available.

Main Article Content

Abstract

Numerous studies have primarily focused on investigating the linguistic structures of academic writing, such as theses, dissertations, and articles from reputable journals authored by individuals ranging from novices to experts. However, few studies have examined the linguistic structures of texts written by AI, particularly those produced by ChatGPT. This study aims to analyze the lexical bundle structure and function variations of 10 argumentative essays generated by ChatGPT, which were composed based on prompts provided by advanced learners in Indonesia, specifically graduate students of applied linguistics from Yogyakarta University. The objective is to explore the lexical bundle structure and function of ChatGPT-generated essays to understand how the AI employs various linguistic forms and constructs relationships between sentences. For data collection, this study utilized the corpus tool AntConc's N-gram feature to refine the four-word lexical bundles from the collected essays. The analysis used the frameworks of Hyland (2008b) and Biber et al. (1999). The result showed the Noun Phrase + pattern as the most frequent lexical bundle structure found in ChatGPT-generated essays. This structure has been used primarily to assert ideas and positions on the discussed topics (Stance Features), marking that ChatGPT has a strong ability in presenting and elaborating ideas. However, the least frequently found lexical bundle function is text construction that can link one idea to others to create the connection. Therefore, this study suggested that ChatGPT-generated essays can assist in effectively conveying the writer's perspectives but need attention or development in creating cohesive links between ideas in written discourse.

Article Details

License

Copyright (c) 2025 Syafina Azalia, Pratomo Widodo, Pangesti Wiedarti, Titik Sudartinah

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Authors who publish in this journal agree with the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
  4. This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
How to Cite
Azalia, S., Widodo, P., Wiedarti, P., & Sudartinah, T. (2025). Lexical Bundle Structure and Function of ChatGPT-Generated Essay: Corpus-Based Study of Advanced Learners in Indonesia. JOALL (Journal of Applied Linguistics and Literature), 10(2), 515–533. https://doi.org/10.33369/joall.v10i2.39244
Download Citation
Endnote/Zotero/Mendeley (RIS)
BibTeX

References

  1. Acorinti, W. H., & Bocorny, A. E. P. (2024). Lexical Bundles in Computer Science Academic Texts Produced by Novice and Expert Writers. Journal of the Undergraduate Linguistics Association of Britain, 2(2), 189–210. https://doi.org/https://doi.org/10.5281/zenodo.12738429
  2. Aldabbus, S., & Almansouri, E. (2022). Academic Writing Difficulties Encountered by University EFL Learners. British Journal of English Linguistics, 10, 1–11. https://www.eajournals.org/
  3. Aljuaid, H. (2024). The Impact of Artificial Intelligence Tools on Academic Writing Instruction in Higher Education: A Systematic Review. Arab World English Journal, 1(1), 26–55. https://doi.org/10.24093/awej/chatgpt.2
  4. Alqasham, F. H., Al-Ahdal, A. A. M. H., & Babekir, A. H. S. (2021). Coherence and Cohesion in Saudi EFL Learners’ Essay Writing: A Study at a Tertiary-level Institution. Asian EFL Journal Research Articles, 28(1), 8–25. https://www.researchgate.net/profile/Arif-Al-Ahdal/publication/349256060_Coherence_and_Cohesion_in_Saudi_EFL_Learners’_Essay_Writing_A_Study_at_a_Tertiary-level_Institution/links/60270fc545851589399ee195/Coherence-and-Cohesion-in-Saudi-EFL-Learners-Essay-Writing-A-Study-at-a-Tertiary-level-Institution.pdf
  5. Alsariera, A. H., & Yunus, K. (2023). Issues and Challenges in the Use of Coherence Among Jordanian EFL Students in Writing Academic Essays. Journal of Nusantara Studies (JONUS), 8(2), 141–156. https://doi.org/10.24200/jonus.vol8iss2pp141-156
  6. Anindita, W. K. (2024). Cohesion and Coherence Problems Among Non-Native English Students’ Writing Essays. Lensa: Kajian Kebahasaan, Kesusastraan, Dan Budaya, 14(1), 58. https://doi.org/10.26714/lensa.14.1.2024.58-79
  7. Barrot, J. S. (2023). Using ChatGPT for second language writing: Pitfalls and potentials. Assessing Writing, 57. https://doi.org/10.1016/j.asw.2023.100745
  8. Biber, D. (2004). If you look at ...: Lexical Bundles in University Teaching and Textbooks. Applied Linguistics, 25(3), 371–405. https://doi.org/10.1093/applin/25.3.371
  9. Biber, D., & Barbieri, F. (2007). Lexical bundles in university spoken and written registers. English for Specific Purposes, 26(3), 263–286. https://doi.org/10.1016/j.esp.2006.08.003
  10. Biber, D., Johansson, S., Leech, G., Conrad, S., & Finegan, E. (1999). Longman grammar of spoken and written english. Longman.
  11. Bisriyah, M. (2022). EFL University Students’ Difficulties in the Essay Writing Process. Scope: Journal of English Language Teaching, 7(1), 66. https://doi.org/10.30998/scope.v7i1.13793
  12. Bom, H. S. H. (2023). Exploring the Opportunities and Challenges of ChatGPT in Academic Writing: a Roundtable Discussion. In Nuclear Medicine and Molecular Imaging (Vol. 57, Issue 4, pp. 165–167). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/s13139-023-00809-2
  13. Chia, C. S. C., Jonathan, P., Owen, H., & Kit-Mun, L. (2024). Graduate Students’ Perception and Use of ChatGPT as a Learning Tool to Develop Writing Skills. International Journal of TESOL Studies. https://doi.org/10.58304/ijts.20240308
  14. Fauzan, U., Hasanah, N., & Hadijah, S. (2022). The Undergraduate Students’ Difficulties in Writing Thesis Proposal. Indonesian Journal of EFL and Linguistics, 7(1), 175. https://doi.org/10.21462/ijefl.v7i1.515
  15. Fitriyah, I., Ningrum, A. S. B., & Gozali, I. (2023). An Investigation of Written Corrective Feedback in EFL Writing Assessment: How Teachers’ Feedback Practices Meet Students’ Expectations. International Journal of Language Testing, 14(1), 166–184. https://doi.org/10.22034/IJLT.2023.411616.1275
  16. Gayed, J. M., Carlon, M. K. J., Oriola, A. M., & Cross, J. S. (2022). Exploring an AI-based writing Assistant’s impact on English language learners. Computers and Education: Artificial Intelligence, 3. https://doi.org/10.1016/j.caeai.2022.100055
  17. Harunasari, S. Y., Tinggi, S., & Asing, B. (2023). Examining the Effectiveness of AI-integrated Approach in EFL Writing: A Case of ChatGPT. International Journal of Progressive Sciences and Technologies (IJPSAT, 39(2), 357–368.
  18. Hayawi, K., Shahriar, S., & Mathew, S. S. (2024). The imitation game: Detecting human and AI-generated texts in the era of ChatGPT and BARD. Journal of Information Science. https://doi.org/10.1177/01655515241227531
  19. Hong, A. L., & Hua, T. K. (2018). Specificity in English for Academic Purposes (EAP): A corpus analysis of lexical bundles in academic writing. In 3L: Language, Linguistics, Literature (Vol. 24, Issue 2, pp. 82–94). Penerbit Universiti Kebangsaan Malaysia. https://doi.org/10.17576/3L-2018-2402-07
  20. Husnaini, M., & Madhani, L. M. (2024). Perspektif Mahasiswa terhadap ChatGPT dalam Menyelesaikan Tugas Kuliah. Journal of Education Research, 5(3), 2655–2664. https://doi.org/10.37985/jer.v5i3.1047
  21. Hwang, G. J., & Chang, C. Y. (2023). A review of opportunities and challenges of chatbots in education. In Interactive Learning Environments (Vol. 31, Issue 7, pp. 4099–4112). Routledge. https://doi.org/10.1080/10494820.2021.1952615
  22. Hyland, K. (2008a). Academic clusters: text patterning in published and postgraduate writing. International Journal of Applied Linguistics, 18(1), 41–62. https://doi.org/10.1111/j.1473-4192.2008.00178.x
  23. Hyland, K. (2008b). As can be seen: Lexical bundles and disciplinary variation. English for Specific Purposes, 27(1), 4–21. https://doi.org/10.1016/j.esp.2007.06.001
  24. Irfan, I., Sofendi, S., & Vianty, M. (2020). Technological knowledge application on academic writing English education study program students. English Review: Journal of English Education, 9(1), 157–166. https://doi.org/10.25134/erjee.v9i1.3788
  25. Jalilifar, A., & Niamadpour, V. (2024). Teaching English as a Second Language Quarterly (TESLQ) (Formerly Journal of Teaching Language Skills) Online Book Reviews in Sciences: Structural and Functional Differences in Lexical Bundles. Formerly Journal of Teaching Language Skills), 43(4), 87–116. https://doi.org/10.22099/tesl.2024.49990.3280
  26. Jowarder, M. I. (2023). The Influence of ChatGPT on Social Science Students: Insights Drawn from Undergraduate Students in the United States. Indonesian Journal of Innovation and Applied Sciences (IJIAS), 3(2), 194–200. https://doi.org/10.47540/ijias.v3i2.878
  27. Khamkhien, A. (2021). Functional Patterns of Lexical Bundles and Limitations in Academic Writing by Thai L2 English Learners. Journal of English Language Teaching and Linguistics, 6(3), 607. https://doi.org/10.21462/jeltl.v6i3.629
  28. Kim, S., & Kessler, M. (2022). Examining L2 English University students’ uses of lexical bundles and their relationship to writing quality. Assessing Writing, 51. https://doi.org/10.1016/j.asw.2021.100589
  29. Lee, I. (2021). The Development of Feedback Literacy for Writing Teachers. TESOL Quarterly, 55(3), 1048–1059. https://doi.org/10.1002/tesq.3012
  30. Limbong, S., Alberto, & Frans Tandibura. (2023). Lecturer’s Personal and Social Competence Toward Students’ Writing Proficiency in EFL Classroom. Journal of English Education and Teaching, 7(4), 914–927. https://doi.org/10.33369/jeet.7.4.914-927
  31. Liu, X., Ou, J., Song, Y., & Jiang, X. (2021). Exploring Discourse Structures for Argument Impact Classification. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 3958–3969. https://doi.org/10.18653/V1/2021.ACL-LONG.306
  32. Long, B., Shao, S., Yao, J., & Zhang, J. (2024). Structural and Functional Usages of Lexical Bundle in Native and Non-Native English Sociology Academic Writings: A Comparative Study Based on MICUSP. English Language Teaching and Linguistics Studies, 6(4), p11. https://doi.org/10.22158/eltls.v6n4p11
  33. Mahapatra, S. (2024). Impact of ChatGPT on ESL students’ academic writing skills: a mixed methods intervention study. Smart Learning Environments, 11(1). https://doi.org/10.1186/s40561-024-00295-9
  34. Malik, Z. A. (2023). A Corpus-based Study of the Lexical Bundles in the Ph. D Linguistics Dissertations’ Abstracts in Pakistani Universities. Pakistan Journal of Humanities and Social Sciences, 11(2), 2317–2325. https://doi.org/10.52131/pjhss.2023.1102.0524
  35. Markey, B., Brown, D. W., Laudenbach, M., & Kohler, A. (2024). Dense and Disconnected: Analyzing the Sedimented Style of ChatGPT-Generated Text at Scale. Written Communication. https://doi.org/10.1177/07410883241263528
  36. Markowitz, D. M., Hancock, J. T., & Bailenson, J. N. (2023). Linguistic Markers of Inherently False AI Communication and Intentionally False Human Communication: Evidence from Hotel Reviews. Journal of Language and Social Psychology. https://doi.org/https://doi.org/10.31234/osf.io/mnyz8
  37. Mizumoto, A., Yasuda, S., & Tamura, Y. (2024). Identifying ChatGPT-generated texts in EFL students’ writing: Through comparative analysis of linguistic fingerprints. Applied Corpus Linguistics, 4(3). https://doi.org/10.1016/j.acorp.2024.100106
  38. Punar Özçelik, N., & Yangın Ekşi, G. (2024). Cultivating writing skills: the role of ChatGPT as a learning assistant—a case study. Smart Learning Environments, 11(1). https://doi.org/10.1186/s40561-024-00296-8
  39. Rababah, L. M., Rababah, M. A., & Al-Khawaldeh, N. N. (2024). Graduate Students’ ChatGPT Experience and Perspectives during Thesis Writing. International Journal of Engineering Pedagogy, 14(3), 22–35. https://doi.org/10.3991/ijep.v14i3.48395
  40. Rahayu, Weda, S., Muliati, & De Vega, N. (2024). Artificial Intelligence in writing instruction: A self-determination theory perspective. XLinguae, 17(1), 234–244. https://doi.org/10.18355/XL.2024.17.01.16
  41. Rahim, W. ur, Emon, M. M. H., & Haque, T. Al. (2023). Advancements in Tertiary-Level Writing: Insights From Bangladeshi Students and Their Evolving Writing Practices. World Languages, Literature and Cultural Studies, 2(2), 26–32. https://doi.org/10.26480/wllcs.02.2023.26.32
  42. Ramadhan, R. A., Abdul Rahim, Darmanto, & Paris, A. S. (2024). Enhancing Academic Writing through Digital Tools: A Systematic Review. Journal of Language and Literature Studies, 4(4), 707–770. https://doi.org/10.36312/jolls.v4i4.2342
  43. Ranade, N., Saravia, M., & Johri, A. (2024). Using rhetorical strategies to design prompts: a human-in-the-loop approach to make AI useful. AI and Society. https://doi.org/10.1007/s00146-024-01905-3
  44. Salazar, D. J. L. (2011). Lexical bundles in scientific English: A corpus-based study of native and non-native writing. www.tdx.cat
  45. Sattra, M., Banjong, B., Intisarn, C., & Anyarat, N. (2024). Rhetorical Moves of AI-Generated Research Article Abstracts and Published Research Article Abstracts in Applied Linguistics. Journal of Humanities and Social Sciences, 8(1). https://so06.tci-thaijo.org/index.php/husojournalpnru/article/view/265142
  46. Soelistiyowati, E., Nugky Permatasari, A., Nugroho, V. A., Shalsabillah, A., & Kusmulyadi, F. (2024). Enhancing College Learners’ Writing Skills through The Integration of ChatGPT: Strategies, Benefits, And Concerns. 8(1). https://ojs.unm.ac.id/eralingua
  47. Ulfa, N., & Muthalib, K. A. (2020). Lexical Bundles In Students’ Essay Writing. English Education Journal (EEJ), 11(3), 367–379.
  48. Wahab, A., Pd, M., Sidik, A. S., Ningsih, F., & Rahim, R. (2024). Exploring The Use Of Digital Writing Tools To Enhance Creative Writing In The Second Semester Of The English Department, Qamarul Huda Badaruddin University. 4(01). https://ejournal.hamjahdiha.org/index.php/pena/article/view/77/77
  49. Watari, T., Takagi, S., Sakaguchi, K., Nishizaki, Y., Shimizu, T., Yamamoto, Y., & Tokuda, Y. (2023). Performance Comparison of ChatGPT-4 and Japanese Medical Residents in the General Medicine In-Training Examination: Comparison Study. JMIR Medical Education, 9(1). https://doi.org/10.2196/52202
  50. Wijaya Kusuma, F., Rukmini, D., & Faridi, A. (2022). The Realization of Lexical Bundle Structures and Functions in English Education Journal. / English Education Journal, 12(3), 437–446. http://journal.unnes.ac.id/sju/index.php/eej
  51. Wing Yee Siu, B., Afzaal, M., Saleh Aldayel, H., & Curle, S. (2024). Unlocking the Mysteries of Academic Writing: A Corpus-based Analysis of Lexical Bundles in L2 English for Engineering Students. SAGE Open, 14(4). https://doi.org/10.1177/21582440241299997
  52. Wu, Y. (2024). Study on the Impact of Utilizing ChatGPT and Other AI Tools for Feedback in EAP Writing Classrooms on the Discursive Writing Performance of English Major Students. Transactions on Social Science, Education and Humanities Research, 4, 143–150. https://doi.org/10.62051/4se95x52
  53. Yang, W., & Fang, Q. (2021). The Structures and Functions of Lexical Bundles in Argumentative Essays by Chinese EFL Students at the Tertiary Level. International Journal of TESOL Studies. https://doi.org/10.46451/ijts.2021.09.03
  54. Yoo, I. W., & Shin, Y. K. (2022). English lexical bundles in a learner corpus of argumentative essays written by Korean university students. Corpora, 17(Supplement), 23–42. https://doi.org/10.3366/cor.2022.0245
  55. Zakaria, S. M., Yunus, M. Md., Nazri, N. M., & Shah, P. M. (2016). Students’ Experience of Using Storybird in Writing ESL Narrative Text. Creative Education, 07(15), 2107–2120. https://doi.org/10.4236/ce.2016.715210