Main Article Content

Abstract

The increasingly frequent use of ChatGPT in higher education raises questions about its impact on how students critically read a range of academic texts. However, empirical evidence examining the relationship between the dependence and critical use of ChatGPT and college students' critical reading ability is limited. Three aspects were investigated in this study: students' dependence on ChatGPT, their critical use of ChatGPT, and how these relate to students' critical reading skills. This study aimed to examine university students, specifically 79 students at a public university in Indonesia. Students were given a critical reading test, which was in the form of an essay, and there was also a questionnaire to measure students' dependency and critical use of ChatGPT. The results were descriptive, showing that the students' level of ChatGPT dependency was moderate (mean = 3.10) and their level of critical use was quite good (mean = 3.87). For critical reading scores, results ranged from 31.25 to 92.19, with an average in the moderate category. The results of multiple linear regression show that neither critical use nor dependence on ChatGPT has a statistically significant relationship with students’ critical reading skills (β = 0.164, p = 0.151; β = −0.071, p = 0.530). Overall, these results indicate that students' engagement with ChatGPT has not had a clear or significant effect on their critical reading performance. Further research is needed to confirm these findings. These findings indicate that reliance on AI and critical use of ChatGPT alone may not be sufficient to influence students' critical reading abilities, suggesting that other factors may also play a role. Therefore, future research should involve a more diverse population and develop more specific, contextually relevant instruments, particularly those linking ChatGPT use to critical reading skills, while also considering other mediating variables.

Keywords

Chatgpt Reliance Critical Use of ChatGPT Critical Reading AI literacy Higher Education

Article Details

How to Cite
Pujiastuti, I., Susanti, S., Lestari, D., & Indrayatti, W. (2026). The Relationship between ChatGPT reliance, critical use, and critical reading skills among Indonesian undergraduate students. JOALL (Journal of Applied Linguistics and Literature), 11(1), 116–132. https://doi.org/10.33369/joall.v11i1.46089

References

  1. AAC&U. (2009). Reading Value Rubric. In AAC&U. https://www.aacu.org/initiatives/value-initiative/value-rubrics/value-rubrics-reading
  2. Adesokan, A., Azeez, S. A., & Raheem, A. O. (2025). Artificial Intelligence Tools : Their Usage and Reliance among Undergraduate Students of Education In Kwara State University, Malete. September.
  3. Anh, V. T. K., & Nguyen, H. (2024). Generative Artificial Intelligence and ChatGPT in Language Learning: EFL Students’ Perceptions of Technology Acceptance. Journal of University Teaching and Learning Practice, 21(06). https://doi.org/10.53761/fr1rkj58
  4. Arifin, Z. (2017). Evaluasi Pembelajaran. Remaja Rosdakarya Offset.
  5. Arslan, A. (2022). Investigation of Secondary School Students ’ Critical Reading Listening / Watching Usage Strategies by Structural Equation Model and. 18(3), 0–2. https://doi.org/10.29329/ijpe.2022.439.20
  6. Bimpong, B. W., Atsise, P., & Owusu, F. (2024). East African Journal of Information Technology Exploring the Implementation of Artificial Intelligence ( AI ) Writing Tools in Teaching and Learning : Faculty and Students ’ Perspectives in Higher. 7(1), 380–393. https://doi.org/10.37284/eajit.7.1.2286.IEEE
  7. Binu. (2024). Exploring the Efficacy of Integrating ChatGPT and Padlet for Augmenting Reading and Writing Proficiency Among Engineering Students. https://doi.org/10.21203/rs.3.rs-4884403/v1
  8. Brundage, M., Clark, J., Allen, G. C., Flynn, C., Farquhar, S., Crootof, R., & Bryson, J. (2018). The Malicious Use of Artificial Intelligence : Forecasting , Prevention , and Mitigation. February 2018.
  9. Budiarti, W. N., Ummah, S., Rifani, E., Syerni, A., Nahdlatul, U., Al, U., & Cilacap, G. (2024). Al Ghazali Internasional Conference. 1, 149–164.
  10. Burkhard, M. (2022). Student Perceptions of Ai-Powered Writing Tools: Towards Individualized Teaching Strategies. https://doi.org/10.33965/celda2022_202207l010
  11. Cahyani, R. Y. D., Dewi, O. C., & Darmawan, A. (2024). The Impact of Artificial Intelligence (AI) on Al-Ghifari University Students’ Critical Reading Skills. Thegist, 6(1). https://doi.org/10.53675/gist.v6i1.1374
  12. Cassum, S. H., & Joanne, P. (2015). Multidimensionality of critical thinking : A holistic perspective from Multidimensionality of critical thinking : A holistic perspective from multidisciplinary educators in Karachi , Pakistan. January 2013. https://doi.org/10.5430/jnep.v3n7p9
  13. Çıldır, M. (2023). Collaborating With ChatGPT: An Exploratory Study of German Language Learning. Alman Dili Ve Kültürü Araştırmaları Dergisi, 5(2), 63–76. https://doi.org/10.55143/alkad.1371058
  14. Hidayatullah, U. H. (2024). Implications of Constructivism Learning Theory on Students ’ Critical Thinking Skills : A Theoretical Study. 09(02), 449–460. https://doi.org/10.18860/abj.v9i2.28331
  15. Idham, A. Z., Rauf, W., & Rajab, A. (2024). Navigating the Transformative Impact of Artificial Intelligence on English Language Teaching: Exploring Challenges and Opportunities. Jurnal Edukasi Saintifik, 4(1), 8–14. https://doi.org/10.56185/jes.v4i1.620
  16. Indianasari, Suharini, E., & Handoyo, E. (2022). The Influence of Self-Efficacy Towards the Learners’ Reading Literacy Skills by Applying Problem Based Learning Model Assisted by Learner-Pocket Book. https://doi.org/10.2991/assehr.k.211125.094
  17. Khamkhong, S. (2018). Developing English L2 Critical Reading and Thinking Skills Through the Pisa Reading Literacy Assessment Framework: A Case Study of Thai EFL Learners. 3l the Southeast Asian Journal of English Language Studies, 24(3), 83–94. https://doi.org/10.17576/3l-2018-2403-07
  18. Khan, R., Grijalva, R., & Enriquez-Gates, A. (2019). Teachers as Change Agents: Promoting Meaningful Professional Development Using Action Research to Support International Educational Reform. Fire Forum for International Research in Education, 5(2). https://doi.org/10.32865/fire201952167
  19. Kim, R. (2024a). Effects of ChatGPT on Korean EFL Learners’ Main-Idea Reading Comprehension via Top-Down Processing. Lanaguage Research, 60(1), 83–106. https://doi.org/10.30961/lr.2024.60.1.83
  20. Kim, R. (2024b). Effects of ChatGPT on Korean EFL Learners ’ Main-Idea Reading Comprehension via Top-Down Processing. 83–106.
  21. Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for Language Teaching and Learning. Relc Journal, 54(2), 537–550. https://doi.org/10.1177/00336882231162868
  22. Koloiz, Z., & Yelovska, Y. (2020). Academic Writing as an Academic Discipline: Problematic Issues. SHS Web of Conferences, 75, 3006. https://doi.org/10.1051/shsconf/20207503006
  23. Lee, H., & Lee, J. H. (2022). The Effects of Robot-Assisted Language Learning: A Meta-Analysis. Educational Research Review, 35, 100425. https://doi.org/10.1016/j.edurev.2021.100425
  24. Levy, A., Agrawal, M., Satyanarayan, A., & Sontag, D. (2021). Assessing the Impact of Automated Suggestions on Decision Making: Domain Experts Mediate Model Errors but Take Less Initiative. 1–13. https://doi.org/10.1145/3411764.3445522
  25. Long, D., & Magerko, B. (2020). What is AI Literacy? Competencies and Design Considerations. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–16. https://doi.org/10.1145/3313831.3376727
  26. Manarin, K., Carey, M., Rathburn, M., & Ryland, G. (2015). Critical Reading in Higher Education: Academic Goals and Social. In Indiana University Press (Vol. 4, Issue 1). Indiana University Press.
  27. McWhorter, K. T. (2014). Academic Reading. Pearson Education.
  28. Min, Shangchao, Bishop, Kyoungwon, & Gary Cook, Howard. (2021). Reading is a multidimensional construct at child-L2-English-literacy onset, but comprises fewer dimensions over time: Evidence from multidimensional IRT analysis. Language Testing, 39(2), 265–288. https://doi.org/10.1177/02655322211045296
  29. Morrill, J., & Noetel, M. (2023). A Short-Form AI Literacy Intervention Can Reduce Over-Reliance on AI. https://doi.org/10.31234/osf.io/hv9qc
  30. Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021). Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2, 100041. https://doi.org/https://doi.org/10.1016/j.caeai.2021.100041
  31. Par, L. (2022). The EFL Students’ Critical Reading Skills Across Cognitive Styles. Jeels (Journal of English Education and Linguistics Studies), 5(1), 73–96. https://doi.org/10.30762/jeels.v5i1.72
  32. Patra, S., Singha, T. S., Kanvinde, M., Mazumdar, A., & Kanjilal, S. (2024). Harnessing AI for Geosciences Education: A Deep Dive into ChatGOT’s Impact. Geoscience Communication Discussions, January, 1–28.
  33. Pujiastuti, I., Damaianti, V. S., Mulyati, Y., Sastromiharjo, A., & Lestari, D. (2025). Ketergantungan Penggunaan AI pada Pendidikan Tinggi : Ancaman terhadap Keterampilan Membaca Teks Akademik. DIGLOSIA : Jurnal Kajian Bahasa, Sastra, Dan Pengajarannya, 8, 473–484. https://doi.org/https://doi.org/10.30872/diglosia.v8i2.1243 Diglosia:
  34. Riani, E., Rejekiningsih, T., & Santosa, E. B. (2024). Video Interaktif untuk Optimalisasi Kemampuan Bernalar Kritis Mewujudkan Profil Pelajar Pancasila. Jiip - Jurnal Ilmiah Ilmu Pendidikan, 7(2), 1249–1257. https://doi.org/10.54371/jiip.v7i2.3345
  35. Sahiruddin, S., Junining, E., Ubaidillah, M., & Len, M. C. (2022). Does Reading Correlate With Students’ Critical Thinking? A Bridge to Literacy Practices. https://doi.org/10.2991/assehr.k.220104.054
  36. Salido, A., Syarif, I., Sari, M., Rias, P., Taufika, R., & Melisa, R. (2025). Social Sciences & Humanities Open Integrating critical thinking and artificial intelligence in higher education : A bibliometric and systematic review of skills and strategies. Social Sciences & Humanities Open, 12(August), 101924. https://doi.org/10.1016/j.ssaho.2025.101924
  37. Shafiq, M., Saleem, Z., & Ijaz, A. (2025). Unlocking Student Satisfaction Through Affective AI Literacy: Advancing Technology Acceptance in AI-Enhanced Education. https://doi.org/10.21203/rs.3.rs-7453581/v1
  38. Sihite, M. R., Meisuri, & Sibarani, B. (2023). Examining the Validity and Reliability of ChatGPT 3 . 5- Generated Reading Comprehension Questions for Academic Texts. Randwick International of Education and Linguistics Science (RIELS) Journal, 4(4), 937–944. https://doi.org/https://doi.org/10.47175/rielsj.v4i4.835 |
  39. Stojanov, A., Liu, Q., Hwee, J., & Koh, L. (2024). University Students ’ Self-Reported Reliance on ChatGPT for Learning : a Latent Profile Analysis Computers and Education : Artificial Intelligence University students ’ self-reported reliance on ChatGPT for learning : A latent profile analysis. May. https://doi.org/10.1016/j.caeai.2024.100243
  40. Talebi, M., & Marzban, A. (2015). The Effect of Teaching Critical Reading Strategies on Advanced Iranian EFL Learners’ Vocabulary Retention. Theory and Practice in Language Studies, 5(3), 572. https://doi.org/10.17507/tpls.0503.17
  41. Terasne, T., Hanan, A., & Utama, I. M. P. (2022). Investigating Factors Influencing Efl Students’ Critical Thingking Skill and Reading Achivents in Reading Classroom. Jurnal Ilmiah Mandala Education, 8(4). https://doi.org/10.58258/jime.v8i4.4014
  42. Veldhuis, A., Lo, P. Y., Kenny, S., & Antle, A. N. (2025). International Journal of Child-Computer Interaction Critical Artificial Intelligence literacy : A scoping review and framework synthesis. 43(October 2024).
  43. Walter, Y. (2024). Embracing the future of Artificial Intelligence in the classroom : the relevance of AI literacy , prompt engineering , and critical thinking in modern education. International Journal of Educational Technology in Higher Education. https://doi.org/10.1186/s41239-024-00448-3
  44. Wu, S. (2016). Appraisal Research: A Model of Critical Reading. Sino-Us English Teaching, 13(12). https://doi.org/10.17265/1539-8072/2016.12.006
  45. Yim, I. H. Y., & Wegerif, R. (2024). Teachers’ Perceptions, Attitudes, and Acceptance of Artificial Intelligence (AI) Educational Learning Tools: An Exploratory Study on AI Literacy for Young Students. Future in Educational Research, 2(4), 318–345. https://doi.org/10.1002/fer3.65