| Title: |
Frontier Model Chatbots Can Help Instructors Create, Improve, and Use Learning Objectives |
| Language: |
English |
| Authors: |
Gregory J. Crowther (ORCID 0000-0003-0530-9130); Merrill D. Funk; Kelly M. Hennessey; Marcus M. Lawrence (ORCID 0000-0001-7106-574X) |
| Source: |
Advances in Physiology Education. 2025 49(1):219-229. |
| Availability: |
American Physiological Society. 9650 Rockville Pike, Bethesda, MD 20814-3991. Tel: 301-634-7164; Fax: 301-634-7241; e-mail: webmaster@the-aps.org; Web site: https://www.physiology.org/journal/advances |
| Peer Reviewed: |
Y |
| Page Count: |
11 |
| Publication Date: |
2025 |
| Sponsoring Agency: |
National Science Foundation (NSF), Research Coordination Networks in Undergraduate Biology Education (RCN-UBE) |
| Contract Number: |
1624200 |
| Document Type: |
Journal Articles; Reports - Research; Tests/Questionnaires |
| Education Level: |
Higher Education; Postsecondary Education |
| Descriptors: |
Artificial Intelligence; Learning Objectives; Technology Uses in Education; Curriculum Design; Curriculum Implementation; Best Practices; Evaluation Methods; Educational Quality; Undergraduate Study; Exercise Physiology; Anatomy; Perceptual Motor Learning; Taxonomy; Evaluation Criteria |
| DOI: |
10.1152/advan.00159.2024 |
| ISSN: |
1043-4046; 1522-1229 |
| Abstract: |
Learning objectives (LOs) are a pillar of course design and execution and thus a focus of curricular reforms. This study explored the extent to which the creation and usage of LOs might be facilitated by three leading chatbots: ChatGPT-4o, Claude 3.5 Sonnet, and Google Gemini Advanced. We posed three main questions, as follows: "question A": when given course content, can chatbots create LOs that are consistent with five best practices in writing LOs?; "question B": when given LOs for a low level of the revised Bloom's taxonomy, can chatbots convert them to a higher level?; and "question C": when given LOs, can chatbots create assessment questions that meet six criteria of quality? We explored these questions in the context of four undergraduate courses: Applied Exercise Physiology, Human Anatomy, Human Physiology, and Motor Learning. According to instructor ratings, chatbots had a >70% success rate on most individual criteria for questions A--C. However, chatbots' "difficulties" with a few criteria (e.g., provision of appropriate context for an LO's action, assignment of an appropriate revised Bloom's taxonomy level) meant that, overall, only 38.3% of chatbot outputs fully met all criteria and thus were possibly ready for use with students. Our findings thus underscore the continuing need for instructor oversight of chatbot outputs but also illustrate chatbots' potential to expedite the design and improvement of LOs and LO-related curricular materials such as test question templates (TQTs), which directly align LOs with assessment questions. |
| Abstractor: |
As Provided |
| Entry Date: |
2025 |
| Accession Number: |
EJ1464069 |
| Database: |
ERIC |