Researchers evaluated how well AI models GPT-4 and ChatGPT perform on the US Medical Licensing Examination questions focused on soft skills like judgment and empathy. GPT-4 outperformed both ChatGPT and human test-takers, answering 90% of questions correctly, while ChatGPT had a 62.5% accuracy rate.
By Tarun Sai LomteOct 2 2023Reviewed by Susha Cheriyedath, M.Sc. In a recent study published in the journal Scientific Reports, researchers evaluated the performance of Generative Pre-trained Transformer-4 and ChatGPT in the United States Medical Licensing Examination soft skills.
The USMLE Step 2 Clinical Knowledge scores predict performance across performance domains, such as communication, professionalism, teamwork, and patient care. Artificial cognitive empathy is an emerging field of interest. Understanding the capacity of AI to accurately perceive and respond to patients' emotional states will be particularly relevant in patient-centered care and telemedicine.
Sample test questions were screened, and 21 questions were selected, which require professionalism, interpersonal and communication skills, cultural competence, leadership, organizational behavior, and legal/ethical issues. Questions that require medical or scientific knowledge were not selected. Findings The overall accuracy of ChatGPT was 62.5%. It was 66.6% accurate for the USMLE sample test and 61% for AMBOSS questions. GPT-4 showed superior performance, achieving an overall accuracy of 90%. GPT-4 answered the USMLE sample test with 100% accuracy; however, its accuracy for AMBOSS questions was 86.4%. Regardless of whether the initial response was correct, GPT-4 never changed its response when prompted to re-evaluate its initial answer.
Österreich Neuesten Nachrichten, Österreich Schlagzeilen
Similar News:Sie können auch ähnliche Nachrichten wie diese lesen, die wir aus anderen Nachrichtenquellen gesammelt haben.
Researchers find potential target for prompting fat cells to expend energyA research team led by Emma Robinson, Ph.D., and Timothy McKinsey, Ph.D., at the University of Colorado School of Medicine has identified a potential target for treating obesity and metabolic disease that could enhance the effectiveness of existing anti-obesity drugs.
Weiterlesen »
Researchers develop mixture of compounds to help preserve organs before transplantationUsing zebrafish as a model, investigators have determined a suitable combination of chemical compounds in which to store hearts, and potentially other organs, when frozen for extended periods of time before transplantation.
Weiterlesen »
A quarter of teens with autism go undiagnosed, researchers findAbout a quarter of 16-year-olds with autism spectrum disorder (ASD) have yet to receive a formal diagnosis, according to research from Rutgers.
Weiterlesen »
Researchers find education and occupation influence cardiovascular health and mortalityCardiovascular diseases such as heart attacks and strokes are the most common cause of death worldwide. According to the World Health Organization (WHO), they account for about 18 million deaths each year. The causes of cardiovascular disease are diverse and complex. International studies suggest that socioeconomic status (SES), among other factors, may have an impact on cardiovascular health. SES is defined by the educational attainment, employment status as well as income.
Weiterlesen »
Researchers identify structure in circadian mRNA that affects the sleep-wake cycleCircadian rhythms, the internal biological clocks that regulate our daily activities, are essential for maintaining health and well-being. While the role of transcription in these rhythms is well-established, a new study sheds light on the critical importance of post-transcriptional processes.
Weiterlesen »
Researchers find mitochondrial DNA damage triggers spread of Parkinson's disease-like pathologyUntil recently, our understanding of Parkinson's disease has been quite limited, which has been apparent in the limited treatment options for management of this debilitating condition.
Weiterlesen »