The effectiveness of using ChatGPT on the critical thinking skills of Vocational High School accounting students

Rahmawati Rahmawati; Nujmatul Laily

doi:10.26740/jupe.v14n3.p297-308

Authors

Rahmawati Rahmawati Universitas Negeri Malang
Nujmatul Laily Universitas Negeri Malang

DOI:

https://doi.org/10.26740/jupe.v14n3.p297-308

Keywords:

Generative Artificial Intelligence, ChatGPT, Critical Thinking Skills, Accounting Student

Abstract

This study aims to determine the effectiveness of ChatGPT use on the critical thinking skills of vocational high school accounting students in banking services courses. The research method uses a quantitative approach with a quasi-experimental type in the form of a nonequivalent control group design.. The research sample was conducted at SMK Negeri 1 Malang which consisted of two classes, namely the experimental class in class XI AKL (Financial and Institutional Accounting) 3 and the control class in class XI AKL 1. The data were analyzed using the Independent Sample T-Test and N-Gain analysis. The findings indicate that there were differences in test scores between the two classes, with the experimental class showing greater improvement than the control class. The use of ChatGPT in education suggests that it can support students’ critical thinking skills as long as it is used under the guidance of a teacher who provides appropriate direction.

Downloads

Download data is not yet available.

References

Afifah, S. N., Dahlan, D., & Kurniawati, S. (2025). A critical thinking research trends: A bibliometric analysis (2020–2025). Journal of Educational Sciences, 9(6), 5102–5115. doi:10.31258/jes.9.6.p.5102-5115

Ali, D., Fatemi, Y., Boskabadi, E., Nikfar, M., Ugwuoke, J., & Ali, H. (2024). ChatGPT in teaching and learning: A systematic review. Education Sciences, 14(6), 643. doi:10.3390/educsci14060643

Almazrou, S., Alanezi, F., Almutairi, S. A., Aboalsamh, H. M., Alsedrah, I. T., Arif, W. M., Alsadhan, A. A., Alsanad, D. S., & Alqahtani, N. S. (2025). Enhancing medical students' critical thinking skills through ChatGPT: An empirical study with medical students. Nutrition and Health, 31(3), 1023–1033. doi:10.1177/02601060241273627

Alviasari, A., Azizah, I., Anggraeni, M. D., & Darpa, M. M. (2025). Analysis of curriculum development and accounting learning at SMK Indonesia Raya. Hipkin Journal of Educational Research, 2(1), 123–138. doi:10.64014/hipkin-jer.v2i1.41

Astuti, D., & Zulaeha, I. (2021). The effectiveness of metacognition strategy instruments for writing in French at level A2 with blended learning. International Journal of Innovative Science and Research Technology, 6(8), 560–566.

Azzahra, N. T., Ali, S. N. L., & Bakar, M. Y. A. (2025). Teori konstruktivisme dalam dunia pembelajaran. Jurnal Ilmiah Research Student, 2(2), 64–75. doi:10.61722/jirs.v2i2.4762

Bannert, M., Kasneci, E., Sessler, K., Stefan, K., Fischer, F., Gasser, U., Groh, G., Stephan, G., Poquet, O., Sailer, M., Schmidt, A., & Seidel, T. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 102274. doi:10.1016/j.lindif.2023.102274

Burney, L., Church, K., Akpan, M., & Dell, S. (2023). ChatGPT and AI in accounting education and research. Technology & Analytics, 1–29.

Bustomi, Sukardi, I., & Astuti, M. (2024). Pemikiran konstruktivisme dalam teori pendidikan kognitif Jean Piaget dan Lev Vygotsky. Jurnal Review Pendidikan dan Pengajaran (JRPP), 7(4), 16376–16383. Retrieved from http://journal.universitaspahlawan.ac.id/index.php/jrpp

Chiu, T. K. F. (2024). The impact of generative AI (GenAI) on practices, policies and research direction in education: A case of ChatGPT and Midjourney. Interactive Learning Environments, 32(10), 6187–6203. doi:10.1080/10494820.2023.2253861

Cruz, G., Payan-Carreira, R., Dominguez, C., Silva, H., & Morais, F. (2020). What critical thinking skills and dispositions do new graduates need for professional life? Views from Portuguese employers in different fields. Higher Education Research & Development, 39(7), 1–17. doi:10.1080/07294360.2020.178540

Cui, R., & Zhao, L. (2024). Assessing students' critical thinking in dialogue. Journal of Intelligence, 12(11), 1–16. doi:10.3390/jintelligence12110106

Dad, D. H., & Akbar, D. R. A. (2023). Critical thinking as a twenty-first century skill. Journal of Educational Research & Social Sciences Review (JERSSR), 3(1), 8–15.

Dedad, M., Akastangga, F., Harmonis, S., Alaudin, R., & Hafidz, A. (2024). The impact of ChatGPT on the critical thinking ability of UIN Sunan Kalijaga students. Manajemen Teknologi dan Informatika, 13(3), 2023. doi:10.31940/matrix.v13i3.157-165

Deng, R., Jiang, M., Yu, X., Lu, Y., & Liu, S. (2025). Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies. Computers & Education, 227, 105224. doi:10.1016/j.compedu.2024.105224

Drushlyak, M., Lukashova, T., & Semenikhina, O. (2025). ChatGPT-based simulation helps to develop the pre-service mathematics teachers' critical thinking. International Journal of Instruction, 18(1), 153–172. doi:10.29333/iji.2025.1819a

Elsa Sabrina, Yulianti, R., Ambiyar, & Rizal, F. (2024). Mengeksplor dampak interaksi siswa dengan ChatGPT terhadap berpikir kritis dan pemecahan masalah. Indonesian Journal of Computer Science, 13(3), 4875–4883. doi:10.33022/ijcs.v13i3.4073

Essel, H. B., Vlachopoulos, D., Essuman, A. B., & Amankwa, J. O. (2024). ChatGPT effects on cognitive skills of undergraduate students: Receiving instant responses from AI-based conversational large language models (LLMs). Computers and Education: Artificial Intelligence, 6, 100198. doi:10.1016/j.caeai.2023.100198

Garrison, D. R., Anderson, T., & Archer, W. (2001). Critical thinking, cognitive presence, and computer conferencing in distance education. The American Journal of Distance Education, 15(1), 7–23. doi:10.1080/08923640109527071

Grubaugh, S., Levitt, G., & Deever, D. (2023). Harnessing AI to power constructivist learning: An evolution in educational methodologies. Journal of Effective Teaching Methods (JETM), 1(3), 81–83.

Guo, Y., & Lee, D. (2023). Leveraging ChatGPT for enhancing critical thinking skills. Journal of Chemical Education. doi:10.1021/acs.jchemed.3c00505

Haleem, A., Javaid, M., & Pratap, R. (2023). An era of ChatGPT as a significant futuristic support tool: A study on features, abilities, and challenges. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 2(4), 100089. doi:10.1016/j.tbench.2023.100089

Hsu, W., & Silalahi, A. D. K. (2024). Exploring the paradoxical use of ChatGPT in education: Analyzing benefits, risks, and coping strategies through integrated UTAUT and PMT theories using a hybrid approach of SEM and fsQCA. Computers and Education: Artificial Intelligence, 7, 100329. doi:10.1016/j.caeai.2024.100329

Huang, W., Jiang, J., King, R. B., & Fryer, L. K. (2025). Chatbots and student motivation: A scoping review. International Journal of Educational Technology in Higher Education, 22(1). doi:10.1186/s41239-025-00524-2

Huang, Z., Mao, Y., & Zhang, J. (2024). The influence of artificial intelligence technology on college students' learning effectiveness from the perspective of constructivism—Taking ChatGPT as an example. Journal of Education, Humanities and Social Sciences, 30, 40–46.

Kurniawan, N. A., Hidayah, N., & Rahman, D. H. (2021). Analisis kemampuan berpikir kritis siswa SMK. Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan, 6(3), 334. doi:10.17977/jptpp.v6i3.14579

Loria, Junika, C., Natalia, N., Yuliana, A., Wahyuti, S., Studi, P., Agama, P., Keguruan, F., Kristen, P., Agama, I., Negeri, K., Raya, P., & Raya, K. P. (2025). Pembelajaran inkuiri: Konsep, prinsip, dan penerapannya. Jurnal Ilmiah Multidisiplin, 1(6), 4315–4321. doi:10.63822/mabbps58

Maryani, Putri, N. B. H., & Supriadi, B. (2022). Development of physics REACT module assisted with PhET simulations on harmonic vibration materials. Jurnal Ilmu Pendidikan Fisika, 7(2), 157–167. doi:10.26737/jipf.v7i2.2357

Melisa, R., Ashadi, A., Triastuti, A., Hidayati, S., Salido, A., Luansi Ero, P. E., Marlini, C., Zefrin, Z., & Al Fuad, Z. (2025). Critical thinking in the age of AI: A systematic review of AI's effects on higher education. Educational Process: International Journal, 14. doi:10.22521/edupij.2025.14.31

Mulyadi. (2022). Teori belajar konstruktivisme dengan model pembelajaran (inquiry). Jurnal Keislaman, Sosial, Hukum dan Pendidikan, 7(1), 174–187.

Nasr, N. R., Tu, C., Werner, J., Bauer, T., Yen, C., & Sujo-Montes, L. (2025). Exploring the impact of generative AI ChatGPT on critical thinking in higher education: Passive AI-directed use or human–AI supported collaboration? Education Sciences, 15, 1–28.

Nuwa, M. T., Enstein, J., & Sogen, M. M. B. (2025). Pengaruh penggunaan ChatGPT terhadap kemampuan berpikir kritis siswa kelas X dalam pembelajaran informatika di SMA Kristen Citra Bangsa Mandiri Kupang. Jurnal Ilmiah Pendidikan Dasar, 10(4), 487–497.

Oliński, M., Krukowski, K., & Sieciński, K. (2024). Bibliometric overview of ChatGPT: New perspectives in social sciences. Publications, 12(1), 9. doi:10.3390/publications12010009

Prayogi, R. D. (2020). Kecakapan abad 21: Kompetensi digital pendidik masa depan. Manajemen Pendidikan, 14(2), 144–151. doi:10.23917/jmp.v14i2.9486

Qawqzeh, Y. (2024). Exploring the influence of student interaction with ChatGPT on critical thinking, problem solving, and creativity. International Journal of Information and Education Technology, 14(4), 596–601. doi:10.18178/ijiet.2024.14.4.2082

Ratnawati, O. A., Rizaldi, M., Hamdani, M., & Artuti, E. (2024). Penggunaan ChatGPT terhadap berpikir kritis mahasiswa dalam menyelesaikan masalah geometri analitik ruang. Jurnal Ilmiah Pendidikan Matematika, 7, 105–118.

Janse van Rensburg, J. (2024). Artificial human thinking: ChatGPT's capacity to be a model for critical thinking when prompted with problem-based writing activities. Discover Education, 3, 42. doi:10.1007/s44217-024-00113-x

Retnawati, H. (2020). Validitas, reliabilitas, & karakteristik butir: Panduan untuk peneliti, mahasiswa, dan psikometrian. Parama Publishing.

Risanti, N., & Bayu, K. (2022). Analysis of students' critical thinking ability in accounting. International Journal of Innovation, Creativity and Change, 16(2), 15–24.

Rossouw, M., & Steenkamp, G. (2025). Developing the critical thinking skills of first year accounting students with an active learning intervention. The International Journal of Management Education, 23(1), 101086. doi:10.1016/j.ijme.2024.101086

Rosyida, L., & Bahtiar, M. D. (2024). Pengaruh kecerdasan emosional, self-confidence, dan literasi digital terhadap kemampuan berpikir kritis siswa kelas X Akuntansi SMK Negeri 4 Surabaya. Jurnal Pendidikan Ekonomi (JURKAMI), 9(2), 382–395. doi:10.31932/jpe.v9i2.3603

Salido, A., Syarif, I., Sari, M., Rias, P., Taufika, R., & Melisa, R. (2025). Integrating critical thinking and artificial intelligence in higher education: A bibliometric and systematic review of skills and strategies. Social Sciences & Humanities Open, 12.

Statcounter. (2026). AI chatbot market share Indonesia. GlobalStats. Retrieved from https://gs.statcounter.com/ai-chatbot-market-share/all/indonesia

Sugiyono. (2023). Metode penelitian kuantitatif, kualitatif, dan R&D (Edisi ke-2). Alfabeta.

Syahri, A., Efriyanti, L., Zakir, S., & Imamuddin, M. (2024). Pengaruh penggunaan ChatGPT terhadap pola pikir mahasiswa dalam mata kuliah metodologi penelitian: Studi penelitian kuantitatif. Jurnal Inovasi Pendidikan dan Teknologi, 5(1), 135–143.

Thornhill-Miller, B., Camarda, A., Mercier, M., Burkhardt, J. M., Morisseau, T., Bourgeois-Bougrine, S., Vinchon, F., El Hayek, S., Augereau-Landais, M., Mourey, F., Feybesse, C., Sundquist, D., & Lubart, T. (2023). Creativity, critical thinking, communication, and collaboration: Assessment, certification, and promotion of 21st century skills for the future of work and education. Journal of Intelligence, 11(3), 54. doi:10.3390/jintelligence11030054

Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., & Hickey, D. T. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10, 15. doi:10.1186/s40561-023-00237-x

Ulya, Z. (2024). Penerapan teori konstruktivisme menurut Jean Piaget dan teori neuroscience dalam pendidikan. Journal of Education, 7(1), 12–23. Retrieved from http://e-journal.staima-alhikam.ac.id/index.php/al-mudarris

Widiastuti, M., & Hamidi, N. (2023). Analisis keterampilan berpikir kritis siswa sekolah menengah kejuruan menggunakan tes W-GCTA. Jurnal Pendidikan Akuntansi Indonesia, 23(2), 22–36. Retrieved from https://journal.uny.ac.id/index.php/jpakun/article/view/57747/19824

Wolcott, S. K., & Sargent, M. J. (2021). Critical thinking in accounting education: Status and call to action. Journal of Accounting Education, 56, 100731. doi:10.1016/j.jaccedu.2021.100731

Yang, J., & Niu, T. (2026). Exploring the impact of AI feedback on college students' critical thinking: An intervention experiment based on design discipline. Frontiers in Psychology. Retrieved from https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2026.1806913/abstract