The Effectiveness of ChatGPT-Assisted Project-Based Learning in Enhancing Critical Thinking Skills among Pre-Service Teachers

Andri Candra

doi:10.67467/jliet.v1i1.221

Authors

Andri Candra Indonesia Open University Author

DOI:

https://doi.org/10.67467/jliet.v1i1.221

Keywords:

Generative Artificial Intelligence, ChatGPT, Project-Based Learning, Critical Thinking, Pre-Service Teachers

Abstract

The integration of Generative Artificial Intelligence (GenAI) into higher education has created new opportunities to enhance student-centered learning and foster higher-order thinking skills. However, empirical evidence regarding the effectiveness of ChatGPT-assisted Project-Based Learning (PBL) in teacher education remains limited. This study investigated the effectiveness of ChatGPT-assisted PBL in improving the critical thinking skills of pre-service teachers. A quasi-experimental pretest–posttest control group design was employed involving 68 pre-service teachers enrolled in an Educational Technology course. Participants were assigned to an experimental group (n = 34), which received ChatGPT-assisted PBL, and a control group (n = 34), which received conventional PBL. Critical thinking was assessed using a validated performance-based instrument based on Facione’s six dimensions. Data were analyzed using descriptive statistics, Shapiro–Wilk and Levene’s tests, paired and independent samples t-tests, normalized gain (N-Gain), and Cohen’s d. The findings revealed that the experimental group achieved significantly higher critical thinking scores than the control group (t = 7.36, p < 0.001), with a high N-Gain (0.71) compared to a moderate gain (0.43) in the control group. The intervention also demonstrated a large practical effect (Cohen’s d = 0.97), particularly improving students’ analytical reasoning and explanatory abilities. These findings suggest that integrating ChatGPT into Project-Based Learning effectively promotes critical thinking by supporting inquiry, evidence-based reasoning, and reflective learning. The study highlights the potential of Generative AI as a pedagogical partner in preparing future teachers for AI-enhanced educational environments.

References

Bell, S. (2010). Project-based learning for the 21st century: Skills for the future. The Clearing House: A Journal of Educational Strategies, Issues and Ideas, 83(2), 39–43. https://doi.org/10.1080/00098650903505415

Bruner, J. S. (1961). The act of discovery. Harvard Educational Review, 31(1), 21–32.

Creswell, J. W., & Creswell, J. D. (2023). Research design: Qualitative, quantitative, and mixed methods approaches (6th ed.). SAGE Publications.

Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., Albanna, H., Albashrawi, M., Al-Busaidi, A. S., Balakrishnan, J., Barlette, Y., Basu, S., Bose, I., Brooks, L., Buhalis, D., … Wright, R. (2023). So what if ChatGPT wrote it? Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642. https://doi.org/10.1016/j.ijinfomgt.2023.102642

Facione, P. A. (1990). Critical thinking: A statement of expert consensus for purposes of educational assessment and instruction. The Delphi Report. American Philosophical Association.

Facione, P. A. (1990). Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction. The Delphi Report.

Hake, R. R. (1999). Analyzing change/gain scores. Unpublished Manuscript. Indiana University.

Hmelo-Silver, C. E. (2004). Problem-based learning: What and how do students learn? Educational Psychology Review, 16(3), 235–266. https://doi.org/10.1023/B:EDPR.0000034022.16470.f3

Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. Center for Curriculum Redesign.

Kasneci, E., et al. (2023). ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education. Learning and Individual Differences.

Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeiffer, F., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274

Kokotsaki, D., Menzies, V., & Wiggins, A. (2016). Project-based learning: A review of the literature. Improving Schools, 19(3), 267–277. https://doi.org/10.1177/1365480216659733

Kokotsaki, D., Menzies, V., & Wiggins, A. (2016). Project-Based Learning: A Review of the Literature. Improving Schools.

Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410

Lo, C. K. (2023). What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature. Education Sciences.

Luckin, R. (2018). Machine learning and human intelligence: The future of education for the 21st century. UCL Institute of Education Press.

Luckin, R., Holmes, W., Griffiths, M., & Forcier, L. B. (2016). Intelligence unleashed: An argument for AI in education. Pearson Education.

Mayer, R. E. (2021). Multimedia learning (3rd ed.). Cambridge University Press.

OECD. (2023). Generative AI in the classroom: From hype to reality? OECD Publishing.

OpenAI. (2023). GPT-4 Technical Report.

OpenAI. (2023). GPT-4 technical report. arXiv. https://doi.org/10.48550/arXiv.2303.08774

Prince, M. (2004). Does active learning work? A review of the research. Journal of Engineering Education, 93(3), 223–231. https://doi.org/10.1002/j.2168-9830.2004.tb00809.x

Thomas, J. W. (2000). A review of research on project-based learning. Autodesk Foundation.

UNESCO. (2023). Guidance for generative AI in education and research. UNESCO.

Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.

Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education—Where are the educators? International Journal of Educational Technology in Higher Education, 16(39). https://doi.org/10.1186/s41239-019-0171-0