Exploring the use of ChatGPT in improving students' paragraph composition skills
Article Sidebar
Main Article Content
Abstract
This study aims to explore the effectiveness of ChatGPT in improving paragraph composition skills among students. By identifying both the benefits and challenges of using ChatGPT as an educational tool in writing courses, the research addresses a significant gap in the literature regarding AI-driven tools in writing pedagogy. The study employs a qualitative research framework, focusing on an in-depth exploration of students' experiences and perceptions. Five students from the English Language Education Department who have completed a Paragraph Writing course participated in the study, making them ideal for providing relevant insights. Data was collected through interviews, chosen for their ability to elicit detailed, qualitative information directly from the participants. The findings reveal that ChatGPT serves as a valuable resource for students, aiding in the understanding of paragraph writing theories and providing feedback on their writing. However, challenges such as discrepancies between the questions asked and the answers provided by ChatGPT were noted, which could affect its effectiveness as a learning tool. The study underscores the potential of ChatGPT to enhance paragraph composition skills, suggesting its integration into educational settings. It also highlights the need for educators to be aware of the limitations and challenges of using ChatGPT, ensuring that it complements traditional teaching methods effectively. The findings offer a foundation for further research on optimizing the use of AI tools in education, contributing to the development of innovative teaching strategies.
Metrics
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
Alias, N. R., Hasim, Z., Sauffi, K. M., & Bencharif, T. N. (2024). The effectiveness of online feedback and automated writing feedback in improving writing: A systematic literature review. Asian Journal of Research in Education and Social Sciences, 6(2), 900-912. https://myjms.mohe.gov.my/index.php/ajress/article/view/25725
Alisoy, H. (2024). The Role of Teacher Feedback in Enhancing ESL Learners’ Writing Proficiency. Global Spectrum of Research and Humanities, 1(2), 65-72. https://doi.org/10.69760/1rmdzx45
Athanassopoulos, S., Manoli, P., Gouvi, M., Lavidas, K., & Komis, V. (2023). The use of ChatGPT as a learning tool to improve foreign language writing in a multilingual and multicultural classroom. Advances in Mobile Learning Educational Research, 3(2), 818-824. https://doi.org/10.25082/AMLER.2023.02.009
Azaria, A., Azoulay, R., & Reches, S. (2024). ChatGPT is a remarkable tool—for experts. Data Intelligence, 6(1), 240-296. https://doi.org/10.1162/dint_a_00235.
Bantalem, Derseh, Wale., Yirgalem, Fentie, Kassahun. (2024). The transformative power of ai writing technologies: enhancing efl writing instruction through the integrative use of writerly and google docs. Human behavior and emerging technologies, https://doi.org/10.1155/2024/9221377.
Barasa, D. (2024). Demystifying the discourse: Techniques to effective academic writing. Journal of Research and Academic Writing, 1(1), 13-21. https://doi.org/10.58721/jraw.v1i1.571.
Batubara, P., Mefia, W., & Pratama, A. R. (2023). The role of feeedback in improving writing skill. Jurnal Multidisiplin Dehasen (MUDE), 2(3), 531 – 534. https://doi.org/10.37676/mude.v2i3.4395
Bhutoria, A. (2022). Personalized education and artificial intelligence in the United States, China, and India: A systematic review using a human-in-the-loop model. Computers and Education: Artificial Intelligence, 3, 100068. https://doi.org/10.1016/j.caeai.2022.100068.
Black, P., & Wiliam, D. (1998). Inside the black box: Raising standards through classroom assessment. Granada Learning.
Bloom, B. (1956). Taxonomy of educational objectives. Book I: Cognitive domain. New York: David Mckay.
Chaudhry, I. S., Sarwary, S. A. M., El Refae, G. A., & Chabchoub, H. (2023). Time to revisit existing student’s performance evaluation approach in higher education sector in a new era of ChatGPT—a case study. Cogent Education, 10(1), 2210461. https://doi.org/10.1080/2331186x.2023.2210461.
Christian, Tarchi., Alessandra, Zappoli., Lidia, Casado-Ledesma., Eva, Wennås, Brante. (2024). The use of ChatGPT in source-based writing tasks. International Journal of Artificial Intelligence in Education, https://doi.org/10.1007/s40593-024-00413-1.
Clarke, V., & Braun, V. (2016). Thematic analysis. The Journal of Positive Psychology, 12(3), 297–298. https://doi.org/10.1080/17439760.2016.1262613.
Çobanoğulları, F. (2024). Learning and teaching with ChatGPT: Potentials and applications in foreign language education. The EuroCALL Review, 31(1), 4-15. https://doi.org/10.4995/eurocall.2024.19957
Darwin, R. D., Mukminatien, N., Suryati, N., Laksmi, E. D., & Marzuki. (2024). Critical thinking in the AI era: An exploration of EFL students’ perceptions, benefits, and limitations. Cogent Education, 11(1), 2290342. https://doi.org/10.1080/2331186x.2023.2290342.
Dong, L. (2023). ChatGPT in language writing education: Reflections and a research agenda for a ChatGPT feedback engagement framework. Language Teaching Research, 43, 121-131. https://doi.org/10.32038/ltrq.2024.43.07
Elsaadany, M. (2024). Usage of Chat GPT in English as a Foreign Language (EFL) Classrooms: Faculty Member’s Perspective for its Challenges and Opportunities. Maǧallaẗ Kulliyyaẗ Al-Adāb - Ǧāmiʿat AlFayūm, https://doi.org/10.21608/jfafu.2024.280282.2034
Evans, C. (2013). Making sense of assessment feedback in higher education. Review of educational research, 83(1), 70-120. https://doi.org/10.3102/0034654312474350.
Faiz, R., Bilal, H. A. B., Asghar, D. I., & Safdar, A. (2023). Optimizing ChatGPT as a writing aid for EFL learners: balancing assistance and skill development in writing proficiency. Linguistic Forum - A Journal of Linguistics, 5(3), 24–37. https://doi.org/10.53057/linfo/2023.5.3.3.
Fang, X., Ng, D. T. K., Leung, J. K. L., & Chu, S. K. W. (2023). A systematic review of artificial intelligence technologies used for story writing. Education and Information Technologies, 28(11), 14361-14397. https://doi.org/10.1007/s10639-023-11741-5.
Fitria, N., Zahra, C. M., Usman, M., & Usman, B. (2024). Exploring strategies to foster cohesion and coherence in EFL writing: A focus on simple view of writing. Jurnal Sociohumaniora Kodepena (JSK), 5(1), 62-73. https://doi.org/10.54423/jsk.v5i1.180
Garcia, M. C., & Bondoc, B. C. (2024). Mastering the art of technical writing in it: Making complex things easy to understand in Atate campus. World Journal of Advanced Research and Reviews, 22(1), 571-579. https://doi.org/10.30574/wjarr.2024.22.1.1020
Gozali, I., Wijaya, A. R. T., Lie, A., Cahyono, B. Y., & Suryati, N. (2024). ChatGPT as an automated writing evaluation (AWE) tool: Feedback literacy development and awe tools' integration framework. JALT CALL Journal, 20(1), n1. https://doi.org/10.29140/jaltcall.v20n1.1200.
Guba, M. N. A., Awad, A., & Qubâ, A. A. (2024). Grammarly in Teaching Writing to EFL Learners at Low Levels: How Useful Is It?. World Journal of English Language, 14(3), 1-1. https://www.sciedupress.com/journal/index.php/wjel/article/view/24921
Haque, Md. A., & Shuai L. (2024). Exploring ChatGPT and its impact on society. AI and Ethics.1-13. https://doi.org/10.1007/s43681-024-00435-4.
Heathen, T. S., & Lin, D. E. (2024). A Review on the Perks of Using ChatGPT in Education. https://doi.org/10.20944/preprints202406.1060.v1
Heryadi, D. Y., Afiat, M. N., & Kraugusteeliana, K. (2024). Effective social media communication strategies to expand the market reach of MSMEs during Ramadan season. Journal of Contemporary Administration and Management (ADMAN), 2(1), 409-415. https://doi.org/10.61100/adman.v2i1.160
Heuer, H., & Glassman, E. L. (2024). Reliability criteria for news websites. ACM Transactions on Computer-Human Interaction, 31(2), 1-33. https://doi.org/10.1145/3635147
Hikmah, D., & Walida, B. (2024). The Role of ChatGPT in Enhancing Students’ Critical Thinking in Academic Writing. Ethical Lingua: Journal of Language Teaching and Literature, 11(2). https://doi.org/10.30605/25409190.780
Jung, Y., Chen, C., Jang, E., & Sundar, S. S. (2024, May). Do We Trust ChatGPT as much as Google Search and Wikipedia?. In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (pp. 1-9). https://doi.org/10.1145/3613905.3650862
Kallio, H., Pietilä, A. M., Johnson, M., & Kangasniemi, M. (2016). Systematic methodological review: developing a framework for a qualitative semi‐structured interview guide. Journal of advanced nursing, 72(12), 2954-2965. https://doi.org/10.1111/jan.13031
Karam, J. (2023). Reforming higher education through AI. In Governance in Higher Education: Global Reform and Trends in the MENA Region (pp. 275-306). Cham: Springer Nature Switzerland.
Kaur, K., Shilpa, S., & Jindal, R. (2024, July). The ChatGPT revolution: Reshaping education through artificial intelligence. In AIP Conference Proceedings (Vol. 3121, No. 1). AIP Publishing. https://doi.org/10.1063/5.0221430.
Kavak, V. İ., Evis, D., & Ekinci, A. (2024). The use of ChatGPT in language education. Experimental and Applied Medical Science, 5(2), 72-82.https://doi.org/10.46871/eams.1461578
Kiger, M. E., & Varpio, L. (2020). Thematic analysis of qualitative data: AMEE Guide No. 131. Medical teacher, 42(8), 846-854. https://doi.org/10.1080/0142159x.2020.1755030
Kolade, O., Owoseni, A., & Egbetokun, A. (2024). Is AI changing learning and assessment as we know it? Evidence from a ChatGPT experiment and a conceptual framework. Heliyon, 10(4). https://doi.org/10.1016/j.heliyon.2024.e25953.
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023). A survey on measuring cognitive workload in human-computer interaction. ACM Computing Surveys, 55(13s), 1-39. https://doi.org/10.1145/3582272
Krashen, S. (1992). The Input Hypothesis: An Update. In J. E. Alatis (Ed.), Linguistics and language Pedagogy: The State of the Art (pp. 409-431). Georgetown University Press.
Kulprasit, W. (2018). Students' perspective: three types of reflective written feedback. ABAC Journal, http://www.assumptionjournal.au.edu/index.php/abacjournal/article/view/3572
Kurban, C. F., & Şahin, M. (2024). Educational Implications. In The Impact of ChatGPT on Higher Education (pp. 153-179). Emerald Publishing Limited.
Lestari, F. T., Astutik, I., & Werdiningsih, I. (2023). An analysis on cohesive devices of students’ recount paragraphs writing. Pubmedia Jurnal Pendidikan Bahasa Inggris, 1(1), 16. https://doi.org/10.47134/jpbi.v1i1.14
Liu, M., Zhang, L. J., & Biebricher, C. (2024). Investigating students’ cognitive processes in generative AI-assisted digital multimodal composing and traditional writing. Computers & Education, 211, 104977.https://doi.org/10.1016/j.compedu.2023.104977.
Ma, Q., Crosthwaite, P., Sun, D., & Zou, D. (2024). Exploring ChatGPT literacy in language education: A global perspective and comprehensive approach. Computers and education: Artificial intelligence, 7, 100278. https://doi.org/10.1016/j.caeai.2024.100278
Maheswari, K. C. P. (2024). Coherence and Cohesion: An Analysis of The Students’ Recount Paragraphs. Jurnal Penelitian Mahasiswa Indonesia, 4(2), 168-184. https://doi.org/10.36663/jpmi.v4i2.737
Malik, A. R., Pratiwi, Y., Andajani, K., Numertayasa, I. W., Suharti, S., & Darwis, A. (2023). Exploring artificial intelligence in academic essay: higher education student's perspective. International Journal of Educational Research Open, 5, 100296. https://doi.org/10.1016/j.ijedro.2023.100296
Masrul, M., Wicaksono, B. H., Yuliani, S., Erliana, S., & Rasyidah, U. (2024). The dynamic influence of interactive feedback on elevating EFL students’ writing skills. Studies in English Language and Education, 11(1), 8-133. https://doi.org/10.24815/siele.v11i1.30836
McCowan, T. (2015). Three dimensions of equity of access to higher education. Compare: A Journal of Comparative and International Education, 46(4), 645–665. https://doi.org/10.1080/03057925.2015.1043237.
Minh, A. N. (2024). Leveraging ChatGPT for enhancing English writing skills and critical thinking in university freshmen. Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online), 3(2), 51-62. https://doi.org/10.60087/jklst.vol3.n2.p62
Mohammadi, R., Borna, P., & Zoghi, R. (2023). The Effect of Employing Grammarly on Iranian EFL Learners' Writing Performance. International Journal of Research in English Education, 8(5), 187-197. http://ijreeonline.com/article-1-869-en.html
Nazim, M. (2024). Exploring EFL Teachers’ Insights Regarding Artificial Intelligence Driven Tools in Student-Centered Writing Instructions. International Journal of English Linguistics, https://doi.org/10.5539/ijel. v14n3p93.
Nagoshi, K., Zaidi, Z., Wright, A., & Stalvey, C. (2019). Peer assisted feedback: a successful approach for providing feedback on United States Medical Licensing Exam-style clinical skills exam notes in the United States. Journal of educational evaluation for health professions, 16, 29. https://doi.org/10.3352/jeehp.2019.16.29
Nguyen, T. P. T. (2023). The Application of ChatGPT in Language Test Design – The What and How . Proceedings of the AsiaCALL International Conference, 4, 104–115. https://doi.org/10.54855/paic.2348
Pariyanto & Tungka, N. F. (2024). Enhancing writing skills of EFL learners through automated feedback: an empirical investigation. Jurnal Ilmiah Spectral, 10(1), 028-042.https://doi.org/10.47255/gymtcf78
Paul, R., & Elder, L. (2006). Critical Thinking: The Nature of Critical and Creative Thought. Journal of Developmental Education, 30(2), 34–35. http://www.jstor.org/stable/42775621
Pelenkahu, N., Ali, M. I., Tatipang, D. P., Wuntu, C. N., & Rorintulus, O. A. (2024). Metacognitive strategies and critical thinking in elevating EFL argumentative writing proficiency: Practical insights. Studies in English Language and Education, 11(2), 873-892. https://doi.org/10.24815/siele.v11i2.35832
Pitukwong, K., & Saraiwang, S. (2024). Exploring the effectiveness of digital writing tools on Thai EFL students’ writing. Contemporary Educational Technology, 16(3). https://doi.org/10.30935/cedtech/14808
Rababah, L. M., & Talafha, D. K. (2024). Unlocking writing potential: assessing the impact of grammarly on Jordanian EFL students' writing proficiency. Theory and Practice in Language Studies, 14(5), 1486-1492. https://doi.org/10.17507/tpls.1405.21
Rahman, M. N., Chowdhury, S., & McCray, D. (2024). Undergraduate students’ voices on the role of tutorial-based dialogic feedback in developing academic writing skills. Feedback Research in Second Language, 2, 1-18.
https://www.eurokd.com/doi/10.32038/frsl.2024.02.01
Rahmanova, G., Eksi, G. Y., Shahabitdinova, S., Nasirova, G., Sotvoldiyev, B., & Miralimova, S. (2024). Enhancing Writing Skills with social media-Based Corrective Feedback. World Journal of English Language, 15(1). https://doi.org/10.5430/wjel.v15n1p252
Renata, D., Renati, D., Hidayah, N., & Indriani, L. (2024). The Impact of Teacher’s Feedback on Students’ Writing Ability. English Education:Journal of English Teaching and Research, 9(1), 105–113. https://doi.org/10.29407/jetar.v9i1.21669
Rodríguez, L. M. G. & Mosquera, P. A. (2020). The Impact of Feedback and Explicit Rhetorical Instruction on EFL Students’ Writing Proficiency in Higher Education. Atlantis: Journal of the Spanish Association of Anglo-American Studies, https://doi.org/10.28914/ATLANTIS-2020-42.1.07
Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?. Journal of applied learning and teaching, 6(1), 342-363. https://doi.org/10.37074/jalt.2023.6.1.9
Schillings, M., Roebertsen, H., Hans, H. C. M., Savelberg., Diana, H., J., M., Dolmans. (2018). A review of educational dialogue strategies to improve academic writing skills. Active Learning in Higher Education, https://doi.org/10.1177/1469787418810663
Selim, A. (2024). The transformative impact of AI-powered tools on academic writing: perspectives of EFL university students. International Journal Of English Linguistics, 14(14), 10-5539. https://doi.org/10.5539/ijel.v14n1p14
Shah, C., & Bender, E. M. (2024). Envisioning information access systems: What makes for good tools and a healthy Web?. ACM Transactions on the Web, 18(3), 1-24. https://doi.org/10.1145/3649468
Stognieva, O. N. (2024). Using ChatGPT in planning English language classes. Informatics and education. 2024; 39(4), 77-89. https://doi.org/10.32517/0234-0453-2024-39-4-77-89
Sugini, S., Hermawan, T., Somayeh, B., & Polyvios, A. (2024). Mastering effective sentences and motivation on the ability of writing narratives in primary school. Journal of Basic Education Research, https://doi.org/10.37251/jber.v5i1.835
Sundram, P. G. P. H. (2023). Exploring situational writing strategies in English: A systemic functional linguistics analysis of student responses. Malaysian Journal of Social Sciences and Humanities (MJSSH), 8(9), e002470-e002470. https://doi.org/10.47405/mjssh.v8i9.2470
Suseno, E. (2024). Advantages of using translation, paraphrasing, and podcasts to improve natural writing skills. IJIET (International Journal of Indonesian Education and Teaching), 8(2), 223-247. https://doi.org/10.24071/ijiet.v8i2.8590
Susilowati, T., & Fachriza, A. (2024). Enhancing students’ ability in composing a well-developed paragraph through social constructive learning facilitated by peer-assessment. ELTALL: English Language Teaching, Applied Linguistic and Literature, 5(1), 1-13. https://doi.org/10.21154/eltall.v5i1.8738
Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive science, 12(2), 257-285. https://doi.org/10.1016/0364-0213(88)90023-7
Taskiran, A., Yazici, M., & Erdem Aydin, I. (2024). Contribution of automated feedback to the English writing competence of distance foreign language learners. E-Learning and Digital Media, 21(1), 24-41. https://doi.org/10.1177/20427530221139579
Tiwari, H. P. (2024). Perspectives of ELT Teachers in Enhancing Writing Skills through Immediate Feedback. BMC Research Journal, 3(1), 45–60. https://doi.org/10.3126/bmcrj.v3i1.69272
Tseng, Y. C., & Lin, Y. H. (2024). Enhancing English as a foreign language (EFL) learners' writing with ChatGPT: A university-level course design. Electronic Journal of e-Learning, 22(2), 78-97. https://doi.org/10.34190/ejel.21.5.3329
Tsufim, F., & Pomerleau, L. (2024). More is less? Using generative AI for idea generation and diversification in early writing processes. In B. Buyserie and T. N. Thurston (Eds.), Teaching and generative AI: Pedagogical possibilities and productive tensions. Utah State University.
Vũ, Phi, Hổ, Phạm., Anh, Quoc, Le. (2024). ChatGPT in language learning: Perspectives from Vietnamese students in Vietnam and the USA. International journal of language instruction, https://doi.org/10.54855/ijli.24325
Vygotsky, L. S., & Cole, M. (1978). Mind in society: Development of higher psychological processes. Harvard University Press.
Wang, H., Dang, A., Wu, Z., & Mac, S. (2024). Generative AI in higher education: Seeing ChatGPT through universities' policies, resources, and guidelines. Computers and Education: Artificial Intelligence, 7, 100326. https://doi.org/10.1016/j.caeai.2024.100326
Wang, J. (2024). An Empirical Study on Continuation Writing in Senior High School under the Assessment and Feedback of ChatGPT. Journal of Theory and Practice of Contemporary Education, 4(05), 7–22. https://doi.org/10.53469/jtpce.2024.04(05).02.
Watermeyer, R., Shapiro, H., and Zan, C. (2023). The digital evolution of higher education: From high-cost failures to high-risk futures. Digital Futures of Work Research Programme, Working Paper 9. https://digitalfuturesofwork.com/our_publications/working-paper-9-the-digital-evolution-of-higher-education-from-high-cost-failures-to-high-risk-futures/
Wiltshire, G., & Ronkainen, N. (2021). A realist approach to thematic analysis: making sense of qualitative data through experiential, inferential and dispositional themes. Journal of Critical Realism, 20(2), 159-180. https://doi.org/10.1080/14767430.2021.1894909
Wu, Y. (2024). Study on the Impact of Utilizing ChatGPT and Other AI Tools for Feedback in EAP Writing Classrooms on the Discursive Writing Performance of English Major Students. Transactions on Social Science, Education and Humanities Research, 4, 143-150. https://doi.org/10.62051/4se95x52
Xiao, Y., & Zhi, Y. (2023). An Exploratory Study of EFL Learners’ Use of ChatGPT for Language Learning Tasks: Experience and Perceptions. Languages, 8(3), 212. https://doi.org/10.3390/languages8030212
Yu, H. (2024). The application and challenges of ChatGPT in educational transformation: New demands for teachers' roles. Heliyon. https://doi.org/10.1016/j.heliyon.2024.e24289
Zhang, H., Xie, J., Wu, C., Cai, J., Kim, C., & Carroll, J. M. (2024). The future of learning: Large language models through the lens of students. The 25th Annual Conference on Information Technology Education, 12–18. https://doi.org/10.1145/3686852.3687069
Zebua, J. A. Z., & Katemba, C. V. (2024). Students’ Perceptions of Using the OpenAI ChatGPT Application in Improving Writing Skills. Journal of Language and Literature Studies, 4(1), 110–123. https://doi.org/10.36312/jolls.v4i1.1805.
Zhou, Z. (2024). Feasibility Study of Optimizing Junior High School English Writing Assessment and Feedback Using Technological Means. International Journal of New Developments in Education, 6(5).https://dx.doi.org/10.25236/IJNDE.2024.060530