In this article virtual reality (VR)-based procedures for home perimetry (HP) are described and an overview is given of which procedures can already be used today.
In this article virtual reality (VR)-based procedures for home perimetry (HP) are described and an overview is given of which procedures can already be used today.
Criteria for assessment of the significance of scientific articles are presented. The focus is on research design and methodology, illustrated by the classical study on prehospital volume treatment of severely injured individuals with penetrating torso injuries by Bickell et al. (1994). A well-thought out research design is crucial for the success of a scientific study and is documented in a study protocol beforehand. A hypothesis is a provisional explanation or prediction and must be testable, falsifiable, precise, and relevant. There are various types of randomization methods, with the randomized controlled trial being the gold standard for clinical interventional studies. When reading a scientific article it is important to verify whether the research design and setting align with the research question and whether potential sources of error have been considered and controlled. Critical scrutiny should also be applied to references, the funding and expertise of the researchers.
Purpose: In recent years artificial intelligence (AI), as a new segment of computer science, has also become increasingly more important in medicine. The aim of this project was to investigate whether the current version of ChatGPT (ChatGPT 4.0) is able to answer open questions that could be asked in the context of a German board examination in ophthalmology.
Methods: After excluding image-based questions, 10 questions from 15 different chapters/topics were selected from the textbook 1000 questions in ophthalmology (1000 Fragen Augenheilkunde 2nd edition, 2014). ChatGPT was instructed by means of a so-called prompt to assume the role of a board certified ophthalmologist and to concentrate on the essentials when answering. A human expert with considerable expertise in the respective topic, evaluated the answers regarding their correctness, relevance and internal coherence. Additionally, the overall performance was rated by school grades and assessed whether the answers would have been sufficient to pass the ophthalmology board examination.
Results: The ChatGPT would have passed the board examination in 12 out of 15 topics. The overall performance, however, was limited with only 53.3% completely correct answers. While the correctness of the results in the different topics was highly variable (uveitis and lens/cataract 100%; optics and refraction 20%), the answers always had a high thematic fit (70%) and internal coherence (71%).
Conclusion: The fact that ChatGPT 4.0 would have passed the specialist examination in 12 out of 15 topics is remarkable considering the fact that this AI was not specifically trained for medical questions; however, there is a considerable performance variability between the topics, with some serious shortcomings that currently rule out its safe use in clinical practice.
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：