https://doi.org/10.1140/epjqt/s40507-025-00334-5
Research
LLM-generated tips rival expert-created tips in helping students answer quantum-computing questions
1
Embedded Intelligence, German Research Center for Artificial Intelligence, 67663, Kaiserslautern, Germany
2
Department of Computer Science and Research Initiative QC-AI, RPTU Kaiserslautern-Landau, 67663, Kaiserslautern, Germany
3
Department of Physics and Research Center OPTIMAS, RPTU Kaiserslautern-Landau, 67663, Kaiserslautern, Germany
4
Fraunhofer Institute for Industrial Mathematics, 67663, Kaiserslautern, Germany
5
Fraunhofer Center for Maritime Logistics and Services, 21073, Hamburg, Germany
Received:
24
July
2024
Accepted:
24
February
2025
Published online:
4
March
2025
Alleviating high workloads for teachers is crucial for continuous high quality education. To evaluate if Large Language Models (LLMs) can alleviate this problem in the quantum computing domain, we conducted two complementary studies exploring the use of GPT-4 to automatically generate tips for students. (1) A between-subject survey in which students (N = 46) solved four multiple-choice quantum computing questions with either the help of expert-created or LLMgenerated tips. To correct for possible biases, we additionally introduced two deception conditions. (2) Experienced educators and students (N = 23) directly compared the LLM-generated and expert-created tips. Our results show that the LLM-generated tips were significantly more helpful and pointed better towards relevant concepts while also giving away more of the answers. Furthermore, we found that participants in the first study performed significantly better in answering the quantum computing questions when given tips labeled as LLM-generated, even if they were expert-created. This points towards a placebo effect induced by the participants’ biases for LLM-generated content. Ultimately, we contribute that LLM-generated tips can be used instead of expert tips to support teaching of quantum computing basics.
Key words: Large Language Models / Quantum computing / Education / Survey
© The Author(s) 2025
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
