We use cookies to understand how you use our site and to improve your experience. This includes personalizing content and advertising. To learn more, click here. By continuing to use our site, you accept our use of cookies. Cookie Policy.

Features Partner Sites Information LinkXpress
Sign In
Advertise with Us
GLOBETECH PUBLISHING LLC

Download Mobile App




Study Finds AI Falls Short When Analyzing Medical Data

By MedImaging International staff writers
Posted on 20 Nov 2018
Print article
A study conducted at the Icahn School of Medicine at Mount Sinai (New York, NY, USA) has found that artificial intelligence (AI) tools trained to detect pneumonia on chest X-rays suffered significant decreases in performance when tested on data from outside health systems. These findings suggest that unless AI in the medical space is carefully tested for performance across a wide range of populations, the deep learning models may not perform as accurately as expected.

Amidst the growing interest in the use of computer system frameworks called convolutional neural networks (CNN) to analyze medical imaging and provide a computer-aided diagnosis, recent studies have found that AI image classification may not generalize to new data as well as commonly portrayed. The researchers at the Icahn School of Medicine at Mount Sinai assessed how AI models identified pneumonia in 158,000 chest X-rays across three medical institutions. They chose to study the diagnosis of pneumonia on chest X-rays due to its common occurrence, clinical significance, and prevalence in the research community.

The researchers found that in three out of five comparisons, the performance of CNNs in diagnosing diseases on X-rays from hospitals outside of its own network was significantly lower as compared to X-rays from the original health system. However, CNNs were able to detect the hospital system where an X-ray was acquired with a high-degree of accuracy, and cheated at their predictive task based on the prevalence of pneumonia at the training institution. The researchers found that the key problem in using deep learning models in medicine was their use of a massive number of parameters, making it challenging to identify specific variables driving predictions, such as the types of CT scanners used at a hospital and the resolution quality of imaging.

“Our findings should give pause to those considering rapid deployment of AI platforms without rigorously assessing their performance in real-world clinical settings reflective of where they are being deployed,” said senior author Eric Oermann, MD, Instructor in Neurosurgery at the Icahn School of Medicine at Mount Sinai. “Deep learning models trained to perform medical diagnosis can generalize well, but this cannot be taken for granted since patient populations and imaging techniques differ significantly across institutions.”

“If CNN systems are to be used for medical diagnosis, they must be tailored to carefully consider clinical questions, tested for a variety of real-world scenarios, and carefully assessed to determine how they impact accurate diagnosis,” said first author John Zech, a medical student at the Icahn School of Medicine at Mount Sinai.

Related Links:
Icahn School of Medicine at Mount Sinai

Gold Member
Solid State Kv/Dose Multi-Sensor
AGMS-DM+
Digital Radiography Acquisition Software
VXvue with PureImpact
New
Ultrasound Software
UltraExtend NX
New
Brachytherapy Planning System
Oncentra Brachy

Print article

Channels

Radiography

view channel
:	Image: The AI model could be a valuable adjunct to human radiologists in breast cancer diagnoses and risk prediction (Photo courtesy of 123RF)

AI Model Predicts 5-Year Breast Cancer Risk from Mammograms

Approximately 13% of U.S. women, or one in every eight, are predicted to develop invasive breast cancer over their lifetime, with 1 in 39 women (3%) succumbing to the illness, according to the American... Read more

Nuclear Medicine

view channel
Image: The AI system uses scintigraphy imaging for early diagnosis of cardiac amyloidosis (Photo courtesy of 123RF)

AI System Automatically and Reliably Detects Cardiac Amyloidosis Using Scintigraphy Imaging

Cardiac amyloidosis, a condition characterized by the buildup of abnormal protein deposits (amyloids) in the heart muscle, severely affects heart function and can lead to heart failure or death without... Read more

General/Advanced Imaging

view channel
Image: The CIARTIC Move self-driving mobile C-arm has received FDA clearance (Photo courtesy of Siemens)

Self-Driving Mobile C-Arm Reduces Imaging Time during Surgery

Intraoperative imaging faces significant challenges due to staff shortages and the high demands placed on surgical teams in the operating room (OR). A common challenge during many OR procedures is the... Read more

Imaging IT

view channel
Image: The new Medical Imaging Suite makes healthcare imaging data more accessible, interoperable and useful (Photo courtesy of Google Cloud)

New Google Cloud Medical Imaging Suite Makes Imaging Healthcare Data More Accessible

Medical imaging is a critical tool used to diagnose patients, and there are billions of medical images scanned globally each year. Imaging data accounts for about 90% of all healthcare data1 and, until... Read more
Copyright © 2000-2024 Globetech Media. All rights reserved.