Research on the Teaching Ability of ChatGPT in Traditional Chinese Medicine Majors in Higher Education
College of Traditional Chinese Medicine and Health, Nanfang College, Guangzhou 510970, China
| Abstract: | OBJECTIVE: Test and evaluate the teaching ability of ChatGPT in Traditional Chinese Medicine majors in higher education. METHODS: Using teacher ethics, professional knowledge and teaching ability, teaching design ability, heuristic teaching ability, personalized teaching ability, error correction ability, teaching evaluation ability, and fairness as evaluation indicators, 1940 Q&A sessions are conducted with ChatGPT and then calculate the accuracy and similarity of ChatGPT's output answers. RESULTS: ChatGPT has shown excellent teacher ethics and good personalized teaching ability. However, it does not yet possess the ability to teach traditional Chinese medicine professional knowledge, according to the unsatisfactory test results of "2023 National Postgraduate Entrance Examination TCM Comprehensive Test Paper". The teaching design ability, error correction ability, teaching evaluation ability and heuristic teaching ability in the field of traditional Chinese medicine are all relatively inadequate, based on the corresponding tests. This study also found that the similarity of ChatGPT's responses was not high, with an average similarity of only 61% for all questions, indicating significant differences in textual descriptions when different students ask the same question. This result suggests a certain degree of unfairness in ChatGPT's responses. Misinformation is also found frequently in the responds of ChatGPT. CONCLUSION: ChatGPT is still lack of teaching ability in traditional Chinese medicine majors in higher education, and we should be vigilant against fairness and misinformation. |
| Keywords: | ChatGPT; Higher Education; Teaching Ability; Traditional Chinese Medicine |
| DOI: | 10.57237/j.edu.2025.01.001 |
View:
Downloads:
Received: 1 November 2024
Accepted: 19 December 2024
Published Online: 8 February 2025
Funding
| 1. | The Guangdong Higher Education Society's '14th five-year plan' annual higher education research projects for 2023 (title: exploring the scenarios and risks of artificial intelligence interactive tools promoting digital transformation in higher education using traditional Chinese medicine as an example, No. 23GQN60) |
| 2. | The 2023 school-level teaching quality and teaching reform project construction from Guangzhou Nanfang College (No. XJJG2328) |
| 3. | The 2024 education science planning project (higher education special) from the Office of Guangdong Provincial Education Science Planning Leading Group (No. 2024GXJK462) |
| 4. | The 2024 Guangdong Provincial Teaching Quality and Teaching Reform Project (NO. GDJG2409) |
References
| [1] | Jiao Jianli. ChatGPT Promoting the Digital Transformation of School Education—What to Learn and How to Teach in the Era of Artificial Intelligence [J]. Chinese Distance Education, 2023, 43(04): 16-23. https://doi.org/10.13541/j.cnki.chinade.20230226.001 |
| [2] | Cui Yuhong, Bai Fan, Zhang Ruixin. ChatGPT's Application, Risks, and Countermeasures in Higher Education [J/OL]. Journal of Chongqing University of Technology (Social Sciences): 1-17 (2023-04-27). |
| [3] | Feng Yuhuan. The Application Value, Potential Ethical Risks, and Governance Pathways of ChatGPT in the Field of Education [J]. Ideological and Theoretical Education, 2023(04): 26-32. https://doi.org/10.16075/j.cnki.cn31-1220/g4.2023.04.013 |
| [4] | Chen Zengzhao, Shi Yawen, Wang Mengke. AI's Reality of Promoting Educational Reform—Teachers' Strategies Analysis on Coping with ChatGPT [J/OL]. Journal of Guangxi Normal University (Philosophical and Social Sciences Edition): 1-11. https://doi.org/10.16088/j.issn.1001-6597.2023.02.006 |
| [5] | Yang Haiyan, Li Tao. ChatGPT Teaching Application: Scenarios, Limitations, and Breakthrough Strategies [J]. China Education Informationization, 2023, 29(06): 26-34. |
| [6] | Zhang Feng, Chen Wei. ChatGPT and Higher Education: How Artificial Intelligence Drives Learning Innovation [J/OL]. Journal of Chongqing University of Technology (Social Sciences): 1-12 (2023-04-28). |
| [7] | Zhu Yongxin, Yang Fan. ChatGPT/Generative Artificial Intelligence and Educational Innovation: Opportunities, Challenges, and Future [J]. Journal of East China Normal University (Education Science Edition), 2023, 41(07): 1-14. https://doi.org/10.16382/j.cnki.1000-5560.2023.07.001 |
| [8] | Pan Chenhao, Zhou Ming. The Prospects of ChatGPT in the Field of Traditional Chinese Medicine [J]. Medical Information, 2023, 36(18): 15-20. |
| [9] | Yang Xiaofang, Ma Yupeng, Xu Ying, et al. The Application of ChatGPT Artificial Intelligence Technology in Traditional Chinese Medicine Education and Teaching [J]. Journal of Traditional Chinese Medicine, 2023, 42(06): 23-27. |
| [10] | OpenAI. Introducing ChatGPT [EB/OL]. https://openai.com/blog/chatgpt |
| [11] | He Liang, Ying Zhenyu, Wang Yingying, etc. ChatGPT in Education: A Study on Teaching Ability Diagnosis [J]. Journal of East China Normal University (Education Science Edition), 2023, 41(07): 162-176. https://doi.org/10.16382/j.cnki.1000-5560.2023.07.015 |
| [12] | Ministry of Education's Issuance of "Ten Professional Behavior Guidelines for College Teachers in the New Era" [EB/OL]. (2018-11-14) http://www.moe.gov.cn/srcsite/A10/s7002/201811/t20181115_354921.html |
| [13] | Ministry of Education Announcement on Publicly Soliciting Opinions on the "People's Republic of China Teachers Law (Revised Draft) (Draft for Comment)" [EB/OL]. (2021-11-29). https://www.gov.cn/hudong/2021-11/29/content_5654845.html |
| [14] | Liu Ying, Han Caiyun. 2024 Master of TCM Review Questions and Answers. Beijing: China Medicine and Pharmaceutical Press, 2023. |
| [15] | Ministry of Science and Technology "New Generation Artificial Intelligence Ethics Guidelines" [EB/OL]. (2021-09-26) https://www.safea.gov.cn/kjbgz/202109/t20210926_177063.html |
| [16] | Ministry of Education's Deployment of 2023 National Master's Admission and Final Examination Work [EB/OL]. (2023-03-10) http://www.moe.gov.cn/jyb_xwfb/gzdt_gzdt/s5987/202303/t20230310_1050274.html |
| [17] | Liu Jiantao, Pu Jia. The Application Analysis of Heuristic Teaching Method in "Ma Yuan" Course [J]. Journal of Liaoning University of Technology (Social Sciences Edition), 2023, 25(06): 122-124. https://doi.org/10.15916/j.issn1674-327x.2023.06.032 |
| [18] | Zhang Zerui, Liu Bin. The Development Opportunities and Practice Paths of Personalized Teaching in the Era of Artificial Intelligence [J]. Gansu Education Research, 2023(11): 120-123. |
| [19] | Yuan Rui. The Application of Artificial Intelligence in Personalized Teaching [J]. East China Science & Technology, 2023(11): 53-55. |
| [20] | Wu Jianan, Xu Xiaodong. Research on Teacher Error Correction Literacy in the Digital Age [J]. Open Education Research, 2023, 29(02): 61-73. https://doi.org/10.13966/j.cnki.kfjyyj.2023.02.008 |
| [21] | Li Ji, Zuo Zhengyun. Formulary [M]. Beijing: China Academy of Traditional Chinese Medicine, 2021. |
| [22] | Zhong Gansheng, Yang Baichang. Chinese Medicine [M]. Beijing: China Academy of Traditional Chinese Medicine, 2021. |
| [23] | Yang Zongkai. Using Information Technology to Promote the Reform and Innovation of Educational Evaluation System [J]. People's Education, 2020(21): 30-32. |
Join the Editorial Board
We invite active, qualified and high profile scientists and researchers to join as Editorial Board Members.
Join UsBecome a Reviewer
Scholars with a strong interest in reviewing are invited to join the reviewer panel to ensure the quality of the research to be published.
Join Us