Enhancing Biomedical Education with Real-Time Object Identification through Augmented Reality

Abstract

This paper introduces a mobile augmented reality (AR) platform aimed at training first and second-year STEM majors in college, specifically focusing on the identification and usage of laboratory instruments. The platform addresses the challenges faced by students in introductory STEM courses and utilizes computer vision and AR technologies to create an engaging and learner-centric teaching environment. The platform incorporates features such as a knowledge test, guided navigation using Google Map API, and the ability to build a library of laboratory instruments through augmented reality. Developed using the Unity 3D Game engine and ARkit-XR plugin, the platform currently identifies six laboratory instruments in the biology department, with plans for expansion. The target audience comprises freshman biology majoring and minoring students at the university. The application will be integrated as a pre-lab activity during the semester, requiring the use of specialized equipment. The effectiveness of the platform will be evaluated through a user study conducted within introductory biology courses. This mobile AR platform caters to a specific market niche, addressing the existing resource gap at the university and aiming to enhance the learning experience for biomedical students. Future research will focus on expanding the platform to include chemistry and physics labs while incorporating additional functionalities to deepen students' understanding of laboratory instruments and improve the overall learning environment.