AI in action: Changes to student perceptions when using generative artificial intelligence for the creation of a multimedia project-based assessment

IF 4.2 3区 医学 Q1 PHARMACOLOGY & PHARMACY European journal of pharmacology Pub Date : 2025-03-13 DOI:10.1016/j.ejphar.2025.177508
Kellie A. Charles , Arsalan Yousuf , Han Chow Chua , Slade Matthews , Joanna Harnett , Tina Hinton
{"title":"AI in action: Changes to student perceptions when using generative artificial intelligence for the creation of a multimedia project-based assessment","authors":"Kellie A. Charles ,&nbsp;Arsalan Yousuf ,&nbsp;Han Chow Chua ,&nbsp;Slade Matthews ,&nbsp;Joanna Harnett ,&nbsp;Tina Hinton","doi":"10.1016/j.ejphar.2025.177508","DOIUrl":null,"url":null,"abstract":"<div><h3>Introduction</h3><div>New modes of assessments are needed to evaluate of the authenticity of student learning in an artificial intelligence (AI) world. In mid-2023, we piloted a new assessment type; a collaborative group multimedia assessment with AI allowance. The aim of the research study was to explore the experiences of students using AI in a multimedia assessment. We further aimed to determine whether these use cases changed student perceptions of the ways AI can be used in learning and assessment.</div></div><div><h3>Methods</h3><div>Students enrolled in a capstone Pharmacology interdisciplinary unit (n = 40) were included in an exploratory, qualitative case study methodology. Thematic analysis using an AI role-based conceptual framework was used to explore student perceptions of AI use prior to and during their projects from logbooks documenting the assessment process.</div></div><div><h3>Results</h3><div>AI was initially perceived by students as having a personal tutor-style role, which aligned with the taxonomy with AI acting as an Arbiter (49 %), Oracle (41 %) and Quant (10 %). In contrast to their earlier perceptions, AI was only used in a limited manner in the early stages of assessment in the idea generation in the role as an Oracle (86 %) or in data analytic purposes as a Quant (14 %), (n = 14 cases in 5 groups). No student group used AI to generate written text for the final assessment.</div></div><div><h3>Discussion</h3><div>Tension between perceived and actual use of AI is indicative of the uncertainty faced by students with the allowance of AI within assessments. Clear guidance for educators and students about how to assess the AI-supported learning process is needed to ensure the integrity of the assessment system.</div></div>","PeriodicalId":12004,"journal":{"name":"European journal of pharmacology","volume":"998 ","pages":"Article 177508"},"PeriodicalIF":4.2000,"publicationDate":"2025-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"European journal of pharmacology","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0014299925002626","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PHARMACOLOGY & PHARMACY","Score":null,"Total":0}
引用次数: 0

Abstract

Introduction

New modes of assessments are needed to evaluate of the authenticity of student learning in an artificial intelligence (AI) world. In mid-2023, we piloted a new assessment type; a collaborative group multimedia assessment with AI allowance. The aim of the research study was to explore the experiences of students using AI in a multimedia assessment. We further aimed to determine whether these use cases changed student perceptions of the ways AI can be used in learning and assessment.

Methods

Students enrolled in a capstone Pharmacology interdisciplinary unit (n = 40) were included in an exploratory, qualitative case study methodology. Thematic analysis using an AI role-based conceptual framework was used to explore student perceptions of AI use prior to and during their projects from logbooks documenting the assessment process.

Results

AI was initially perceived by students as having a personal tutor-style role, which aligned with the taxonomy with AI acting as an Arbiter (49 %), Oracle (41 %) and Quant (10 %). In contrast to their earlier perceptions, AI was only used in a limited manner in the early stages of assessment in the idea generation in the role as an Oracle (86 %) or in data analytic purposes as a Quant (14 %), (n = 14 cases in 5 groups). No student group used AI to generate written text for the final assessment.

Discussion

Tension between perceived and actual use of AI is indicative of the uncertainty faced by students with the allowance of AI within assessments. Clear guidance for educators and students about how to assess the AI-supported learning process is needed to ensure the integrity of the assessment system.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
9.00
自引率
0.00%
发文量
572
审稿时长
34 days
期刊介绍: The European Journal of Pharmacology publishes research papers covering all aspects of experimental pharmacology with focus on the mechanism of action of structurally identified compounds affecting biological systems. The scope includes: Behavioural pharmacology Neuropharmacology and analgesia Cardiovascular pharmacology Pulmonary, gastrointestinal and urogenital pharmacology Endocrine pharmacology Immunopharmacology and inflammation Molecular and cellular pharmacology Regenerative pharmacology Biologicals and biotherapeutics Translational pharmacology Nutriceutical pharmacology.
期刊最新文献
AI in action: Changes to student perceptions when using generative artificial intelligence for the creation of a multimedia project-based assessment Netrin-1 binding to UNC5b improves post-stroke neuronal ferroptosis via AMPK-BACH1 pathway Royal Jelly Acid Alleviates Diet-Induced Hyperlipidemia through Regulation of Oxidative Stress and Tryptophan Metabolism. Editorial Board Timosaponin AⅢ inhibits ectopic lipid deposition and enhances the browning of white adipose tissue.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1