Kellie A Charles, Arsalan Yousuf, Han Chow Chua, Slade Matthews, Joanna Harnett, Tina Hinton
{"title":"AI in action: Changes to student perceptions when using generative artificial intelligence for the creation of a multimedia project-based assessment.","authors":"Kellie A Charles, Arsalan Yousuf, Han Chow Chua, Slade Matthews, Joanna Harnett, Tina Hinton","doi":"10.1016/j.ejphar.2025.177508","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>New modes of assessments are needed to evaluate of the authenticity of student learning in an artificial intelligence (AI) world. In mid-2023, we piloted a new assessment type; a collaborative group multimedia assessment with AI allowance. The aim of the research study was to explore the experiences of students using AI in a multimedia assessment. We further aimed to determine whether these use cases changed student perceptions of the ways AI can be used in learning and assessment.</p><p><strong>Methods: </strong>Students enrolled in a capstone Pharmacology interdisciplinary unit (n=40) were included in an exploratory, qualitative case study methodology. Thematic analysis using an AI role-based conceptual framework was used to explore student perceptions of AI use prior to and during their projects from logbooks documenting the assessment process.</p><p><strong>Results: </strong>AI was initially perceived by students as having a personal tutor-style role, which aligned with the taxonomy with AI acting as an Arbiter (49%), Oracle (41%) and Quant (10%). In contrast to their earlier perceptions, AI was only used in a limited manner in the early stages of assessment in the idea generation in the role as an Oracle (86%) or in data analytic purposes as a Quant (14%), (n=14 cases in 5 groups). No student group used AI to generate written text for the final assessment.</p><p><strong>Discussion: </strong>Tension between perceived and actual use of AI is indicative of the uncertainty faced by students with the allowance of AI within assessments. Clear guidance for educators and students about how to assess the AI-supported learning process is needed to ensure the integrity of the assessment system.</p>","PeriodicalId":12004,"journal":{"name":"European journal of pharmacology","volume":" ","pages":"177508"},"PeriodicalIF":4.2000,"publicationDate":"2025-03-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"European journal of pharmacology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.ejphar.2025.177508","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PHARMACOLOGY & PHARMACY","Score":null,"Total":0}
引用次数: 0
Abstract
Introduction: New modes of assessments are needed to evaluate of the authenticity of student learning in an artificial intelligence (AI) world. In mid-2023, we piloted a new assessment type; a collaborative group multimedia assessment with AI allowance. The aim of the research study was to explore the experiences of students using AI in a multimedia assessment. We further aimed to determine whether these use cases changed student perceptions of the ways AI can be used in learning and assessment.
Methods: Students enrolled in a capstone Pharmacology interdisciplinary unit (n=40) were included in an exploratory, qualitative case study methodology. Thematic analysis using an AI role-based conceptual framework was used to explore student perceptions of AI use prior to and during their projects from logbooks documenting the assessment process.
Results: AI was initially perceived by students as having a personal tutor-style role, which aligned with the taxonomy with AI acting as an Arbiter (49%), Oracle (41%) and Quant (10%). In contrast to their earlier perceptions, AI was only used in a limited manner in the early stages of assessment in the idea generation in the role as an Oracle (86%) or in data analytic purposes as a Quant (14%), (n=14 cases in 5 groups). No student group used AI to generate written text for the final assessment.
Discussion: Tension between perceived and actual use of AI is indicative of the uncertainty faced by students with the allowance of AI within assessments. Clear guidance for educators and students about how to assess the AI-supported learning process is needed to ensure the integrity of the assessment system.
期刊介绍:
The European Journal of Pharmacology publishes research papers covering all aspects of experimental pharmacology with focus on the mechanism of action of structurally identified compounds affecting biological systems.
The scope includes:
Behavioural pharmacology
Neuropharmacology and analgesia
Cardiovascular pharmacology
Pulmonary, gastrointestinal and urogenital pharmacology
Endocrine pharmacology
Immunopharmacology and inflammation
Molecular and cellular pharmacology
Regenerative pharmacology
Biologicals and biotherapeutics
Translational pharmacology
Nutriceutical pharmacology.