Attention-guided deep learning for COVID-19 and pneumonia detection in chest X-rays, achieving 84% accuracy with Grad-CAM supervision.

PulmoScore
Two-stage ML workflow for COVID-19 severity scoring on chest X-rays
Highlights
Beth Israel Deaconess Medical Center needed a faster, more accurate tool for diagnosing COVID-19 from chest X-rays.
Design and implement an ML pipeline to segment lungs and assess disease severity on chest radiographs.
Built a two-stage model using DeepLabV3+ and MA-Net, trained on diverse datasets for robust lung and infection detection.
Achieved 0.30 MAE out of 6.0 and 11× faster processing, enabling scalable, real-time diagnostics.
Core Team
Overview
This project developed a two-stage ML-driven workflow for segmenting and scoring lung diseases on chest X-rays, with a focus on COVID-19. The approach combined lung segmentation and disease localization, followed by a severity scoring process to provide quantitative assessments aligned with radiological practices.
Using publicly available datasets, the best-performing solution integrated DeepLabV3+ for lung segmentation and MA-Net for disease segmentation, achieving a mean absolute error (MAE) of 0.30 out of 6.0 – significantly outperforming established methods like BS-net and COVID-Net-S. The workflow is 11 times faster than comparable solutions and adaptable to broader applications, including pneumonia and tuberculosis.
Data
The dataset for this study was carefully curated to address both lung segmentation and disease-scoring tasks, drawing from diverse publicly available sources:
- •Lung Segmentation: 6,810 X-rays from three datasets (Darwin, Montgomery, Shenzhen) providing diverse examples of lung pathologies and healthy subjects
- •Disease Segmentation: 1,364 X-rays from four COVID-19 datasets (ACCD, CRD, CCXD, FCXD) and two normal datasets (CXN, RSNA) representing 580 COVID-19 and 784 normal cases
- •Source Diversity: Data sourced from over 40 institutions worldwide, ensuring robust model generalization
Methods
The proposed workflow inherits the quantification and qualification of lung diseases from expert radiologists and fulfills the following processing steps (Figure 1):
- Stage I (Lung Segmentation): Pixel-level localization of the lungs and removal of irrelevant areas using DeepLabV3+ architecture.
- Stage II (Disease Segmentation): Identification of infected lung regions with nine tested neural networks: U-Net, U-Net++, DeepLabV3, DeepLabV3+, FPN, LinkNet, PSPNet, PAN, and MA-Net.
- Stage III (Severity Scoring): Quantification and qualification of infected regions to compute an overall severity score per patient, aligned with radiological practices.
Results
The proposed workflow demonstrated high accuracy and efficiency in segmenting lungs, identifying infected regions, and computing severity scores for COVID-19 patients:
- Best Accuracy: DeepLabV3+ (Stage I) + MA-Net (Stage II) achieved MAE of 0.30 out of 6.0, significantly outperforming BS-net (MAE: 2.52) and COVID-Net-S (MAE: 1.83).
- Processing Speed: The fastest solution (DeepLabV3+ + PSPNet) processed 12.5 images/second, while the most accurate achieved 7.9 images/second.
- Efficiency Gain: 11× faster than BS-net and COVID-Net-S (0.7 and 0.6 images/s respectively).
The model comparison chart (Figure 2) summarizes the performance across all tested architectures, while Figure 3 shows detailed segmentation results for each neural network.
U-Net · Score: 4
U-Net++ · Score: 5
DeepLabV3 · Score: 0
DeepLabV3+ · Score: 3
FPN · Score: 4
LinkNet · Score: 3
PSPNet · Score: 3
PAN · Score: 5
MA-Net · Score: 5
Conclusion
The proposed two-stage workflow accurately segmented lung regions and quantified infection severity, offering a significant improvement over existing methods in both accuracy and speed. By combining DeepLabV3+ for lung segmentation and MA-Net for disease segmentation, the system provided reliable diagnostic support for COVID-19 and other respiratory diseases.
Future directions include adapting this workflow for real-time clinical deployment and expanding its application to other pulmonary conditions, such as pneumonia and tuberculosis.
Keep Exploring
Real-time landmark tracking for safer valve implantation during TAVI procedures using multi-task deep learning with 97% accuracy.






