A Study on AI-Driven Question Generation Using ChatGPT for Python Programming Education

Authors

  • Khaing Hsu Wai Graduate School of Engineering Science, Akita University, Japan; Language Understanding Lab., Myanmar.
  • Ye Kyaw Thu National Electronics and Computer Technology Center, Pathum Thani, Thailand; Language Understanding Lab., Myanmar. https://orcid.org/0000-0003-3115-6166
  • Thazin Myint Oo Language Understanding Lab., Myanmar. https://orcid.org/0000-0002-0544-4941
  • Nobuo Funabiki Department of Information and Communication Systems, Okayama University, Japan.
  • Lu Xiqin College of Information Science and Engineering, Ritsumeikan University, Japan.
  • Akihiro Yamamura Graduate School of Engineering Science, Akita University, Japan. https://orcid.org/0000-0003-3602-3231

Keywords:

Programming education, Python, ChatGPT in Education, Question generation, Teaching Assistance Tools

Abstract

Programming education is becoming more essential due to the increasing demands on coding skills and computer literacy. Consequently, many professional schools and universities are providing programming courses to train future programming engineers. However, making quizzes and practice questions for diverse programming topics can be time-consuming for the teachers, reducing the time they can spend on teaching, such as guiding students and providing personalized feedback. In this paper, we propose an AI-driven question generation using ChatGPT to support Python programming education. We developed an automated program that can generate three types of questions to cover basic programming concepts: Code Understanding Questions, Output Prediction Questions, and Code Completion Questions by using ChatGPT's language model (LM). For evaluations, we have prepared 28 python source codes and applied 140 generated questions to our Language Understanding lab members in online setting. The examination was conducted as an unsupervised, open-book assessment, allowing participants to reference materials while answering the questions. This setup aimed to simulate a realistic self-learning environment, reflecting how students typically engage with AI-generated questions outside of formal classroom settings. The application results confirm the validity of the proposal and our initial findings indicate that AI-generated questions are effective in supporting both educators and students for Python programming education.

Author Biographies

Khaing Hsu Wai, Graduate School of Engineering Science, Akita University, Japan; Language Understanding Lab., Myanmar.

Khaing Hsu Wai received the B.E. and M.E. degrees in information science and technology from the University of Technology (Yatanarpon Cyber City), Myanmar, in 2016 and 2020, respectively. She earned her Ph.D. degree from the Graduate School of Natural Science and Technology, Okayama University, Japan, in 2024. She is currently an Assistant Professor at the Graduate School of Engineering Science, Center for Crossover Education, Akita University, Japan. Her research interests include educational technology, learning support systems, AI-driven approaches for data science and programming education, and natural language processing. She is a member of the Language Understanding Lab, Myanmar.

Ye Kyaw Thu, National Electronics and Computer Technology Center, Pathum Thani, Thailand; Language Understanding Lab., Myanmar.

Ye Kyaw Thu is a Visiting Professor at the National Electronics and Computer Technology Center (NECTEC), Thailand, where he has been since January 2019, and is the Founder of the Language Understanding Lab in Myanmar. He holds a Doctor of Science (2011) and a Master of Science (2006) from Waseda University, Japan, and a Bachelor of Science in physics from Dagon University, Myanmar (2000). He also holds diplomas in Computer Studies (UK). His research focuses on artificial intelligence (AI), natural language processing (NLP), and human-computer interaction (HCI). He supervises students at various institutions, including Assumption University (AU), Kasetsart University, King Mongkut’s Institute of Technology Ladkrabang (KMITL), Sirindhorn International Institute of Technology (SIIT), and the Japan Advanced Institute of Science and Technology (JAIST).

Thazin Myint Oo, Language Understanding Lab., Myanmar.

Thazin Myint Oo received her Bachelor of Computer Science (B.C.Sc. Hons.) and Master of Computer Science (M.C.Sc.) degrees from the University of Computer Studies, Yangon, in 2005 and 2008, respectively. From 2008 to 2014, she was an Assistant Lecturer at the University of Computer Studies, Yangon, and from 2014 to 2019, she was a Lecturer at Computer University, Kyaing Tong, Myanmar. She served as an Associate Professor at the University of Computer Studies, Yangon, from 2019 to 2021. In 2024, she earned her Ph.D. in computer science from Assumption University, Thailand. She is currently a Senior Researcher at the Language Understanding Lab (LU Lab) in Myanmar.

Nobuo Funabiki, Department of Information and Communication Systems, Okayama University, Japan.

Nobuo Funabiki received the B.S. and Ph.D. degrees in mathematical engineering and information physics from the University of Tokyo, Japan, in 1984 and 1993, respectively. He received the M.S. degree in electrical engineering from Case Western Reserve University, USA, in 1991. From 1984 to 1994, he was with Sumitomo Metal Industries, Ltd., Japan. In 1994, he joined the Department of Information and Computer Sciences at Osaka University, Japan, as an Assistant Professor, and became an Associate Professor in 1995. In 2001, he moved to the Department of Communication Network Engineering (currently the Department of Electrical and Communication Engineering) at Okayama University as a Professor. His research interests include computer networks, optimization algorithms, educational technology, and web technology. He is a member of IEEE, IEICE, and IPSJ.

Lu Xiqin, College of Information Science and Engineering, Ritsumeikan University, Japan.

Lu Xiqin received the B.S. degree in electronic information engineering from Hubei University of Economics, China, in 2017, and the M.S. and Ph.D. degrees from the Graduate School of Natural Science and Technology at Okayama University, Japan, in 2021 and 2024, respectively. She is currently an Assistant Professor at Ritsumeikan University. Her research interests include educational technology and software engineering.

Akihiro Yamamura, Graduate School of Engineering Science, Akita University, Japan.

Akihiro Yamamura received the B.Sc. degree in mathematics from Shimane University, Japan, in 1986, and the Ph.D. degree in mathematics from the University of Nebraska–Lincoln, USA, in 1996. He is currently a Professor in the Course of Mathematical Science, Department of Mathematical and Electrical-Electronic-Computer Engineering, Graduate School of Engineering Science, Akita University, Japan. His research interests include discrete mathematics, algebra, cryptography, information security, and theoretical informatics. He is a member of the American Mathematical Society (AMS), the Association for Computing Machinery (ACM), and the Information Processing Society of Japan (IPSJ).

References

"Top Programming Languages 2024," IEEE Spectrum. Accessed: Jul. 31, 2025. [Online]. Available: https://spectrum.ieee.org/top-programming-languages-2024

M. Heilman and N. A. Smith, “Good question! Statistical ranking for question generation,” in Proc. Human Lang. Technol. Conf. North Amer. Chapter Assoc. Comput. Linguistics (HLT-NAACL), 2010, pp. 609–617.

R. Mitkov, H. L. An, and N. Karamanis, “A computer-aided environment for generating multiple-choice test items,” Natural Language Engineering, vol. 12, no. 2, pp. 177–194, 2006.

J. Finnie-Ansley, P. Denny, B. A. Becker, A. Luxton-Reilly, and J. Prather, “The robots are coming: Exploring the implications of OpenAI Codex on introductory programming,” in Proc. 24th Australasian Comput. Edu. Conf. (ACE), 2022, pp. 10–19.

T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, and A. Askell, “Language models are few-shot learners,” Advances in Neural Information Processing Systems, vol. 33, pp. 1877–1901, 2020.

E. Latif, G. Mai, M. Nyaaba, X. Wu, N. Liu, G. Lu, S. Li, T. Liu, and X. Zhai, “Artificial general intelligence (AGI) for education,” arXiv preprint arXiv:2304.12479, 2023.

C. Kooli, “Chatbots in education and research: A critical examination of ethical implications and solutions,” Sustainability, vol. 15, no. 7, p. 5614, 2023.

G. Cruz, J. Jones, M. Morrow, A. Gonzalez, and B. Gooch, “An AI system for coaching novice programmers,” in Lecture Notes in Computer Science, vol. 10296, Springer, Cham, 2017, pp. 12–21.

S. MacNeil, A. Tran, J. Leinonen, P. Denny, J. Kim, A. Hellas, S. Bernstein, and S. Sarsa, “Automatically generating CS learning materials with large language models,” in Proc. ACM Tech. Symp. Comput. Sci. Edu. (SIGCSE), 2023, p. 1176.

Downloads

Published

2025-10-31

How to Cite

1.
Wai KH, Thu YK, Oo TM, Funabiki N, Xiqin L, Yamamura A. A Study on AI-Driven Question Generation Using ChatGPT for Python Programming Education. j.intell.inform. [internet]. 2025 Oct. 31 [cited 2025 Nov. 7];11(October):1-7. available from: https://ph05.tci-thaijo.org/index.php/JIIST/article/view/176

Issue

JOURNAL OF INTELLIGENT INFORMATICS AND SMART TECHNOLOGY, VOL.11, OCTOBER 2025

Section

Research Articles