Skip to main content
Enterprise AI Analysis: Domain specific multimodal large language model for automated endoscopy reporting with multicenter prospective validation

AI ANALYSIS: MEDICAL DIAGNOSTICS

Domain specific multimodal large language model for automated endoscopy reporting with multicenter prospective validation

Report-Angel, an AI system based on a multimodal large language model (MLLM), was developed for automated upper gastrointestinal (UGI) endoscopy reporting. It demonstrated high accuracy and clinical acceptability in multicenter prospective validation, significantly reducing endoscopists' workloads and standardizing reporting.

Executive Impact

Report-Angel significantly improves reporting efficiency and accuracy, transforming clinical workflows and enhancing diagnostic quality.

79.3% Clinically Acceptable Draft Report Rate (Internal)
83.3% Clinically Acceptable Draft Report Rate (External)
88.51% Report Completeness (Case Level)
78.93% Report Accuracy (Case Level)

Deep Analysis & Enterprise Applications

Select a topic to dive deeper, then explore the specific findings from the research, rebuilt as interactive, enterprise-focused modules.

The introduction highlights the critical need for accurate and efficient endoscopy reporting, noting that traditional methods are labor-intensive and prone to errors. It sets the stage for AI-driven solutions, particularly Multimodal Large Language Models (MLLMs), as a transformative approach to overcome current limitations in medical imaging, extending their application to the dynamic and complex field of digestive endoscopy.

The results demonstrate Report-Angel's strong performance across various metrics. In prospective internal validation, 79.3% of reports were clinically acceptable, rising to 83.3% in the external cohort. Case-level completeness was 88.51% and accuracy was 78.93%. Lesion-level accuracy ranged from 83.94% to 91.92% across datasets, with high reliability for critical findings like high-risk lesions. Processing time averaged 1.5 seconds per lesion, allowing for rapid report generation. Subjective evaluations showed Report-Angel's reports were comparable to senior endoscopists and superior to junior ones in accuracy and completeness.

The discussion contextualizes Report-Angel within the evolving landscape of AI in medical imaging, emphasizing its novel hybrid architecture and ability to generate coherent narrative reports. It underscores the system's role as an assistive tool for clinicians, enhancing efficiency and standardization. Error analysis provides insights for future refinement, particularly in balancing sensitivity for neoplastic lesions against false positives. The study acknowledges limitations, including dataset size and the subjective nature of clinical acceptability, while laying groundwork for broader MLLM application in gastroenterology.

The methods section details the observational study design, including data collection from single- and multi-center retrospective and prospective datasets (RMI-Train, RMI-Test, PMV, PSV, PEV). It describes the data annotation process by expert endoscopists to create gold standards and the system construction, integrating deep learning models for video processing, lesion detection, anatomical landmark identification, and a fine-tuned MLLM (Model 6) for generating descriptions and diagnoses. The prospective validation design and statistical analysis approach are also outlined, ensuring robust evaluation of clinical utility and performance.

83.3% Clinically Acceptable Report Rate in External Validation

Report-Angel achieved an impressive 83.3% clinically acceptable draft report rate in the prospective external validation cohort, demonstrating strong real-world applicability.

Automated Endoscopy Reporting Workflow

Raw Endoscopic Video
Video Pre-processing
Lesion Detection & Annotation
Image Quality Control
MLLM Description & Diagnosis
Automated Report Generation
Manual Review & Sign-off
Feature Report-Angel Junior Endoscopists Senior Endoscopists
Sentence Coherence
  • Comparable to Senior
  • Lower
  • High
Feature Completeness
  • Comparable to Junior
  • Lower
  • Higher
Feature Accuracy
  • Comparable to Senior
  • Lower
  • High
Overall Score
  • Comparable to Senior
  • Lower
  • High

Impact on High-Risk Lesion Identification

In the RMI-Test, Report-Angel achieved 97.50% accuracy in identifying pathologically confirmed gastric neoplasms. This high performance in detecting critical findings underscores its potential for improving diagnostic safety and reducing missed diagnoses, even for subtle or early-stage lesions.

  • Significant accuracy in detecting high-risk gastric lesions.
  • Potential to augment early diagnosis capabilities.
  • Requires final expert verification, especially for rare findings.

Projected Efficiency Gains in Endoscopy Reporting

Estimate the potential time and cost savings by integrating Report-Angel into your endoscopy workflow. Standardized, AI-generated draft reports can drastically reduce the manual effort and time spent on documentation.

Annual Savings $0
Hours Reclaimed Annually 0

Roadmap to AI-Powered Endoscopy Reporting

Our structured approach ensures a seamless integration of Report-Angel into your clinical practice.

Phase 1: Needs Assessment & Customization

Detailed analysis of existing reporting workflows, integration points, and specific requirements for customization to align with your institution's standards.

Phase 2: System Deployment & Integration

Installation of Report-Angel, secure integration with your Electronic Health Records (EHR) system, and initial data synchronization for seamless operation.

Phase 3: Training & Pilot Program

Comprehensive training for endoscopists and support staff, followed by a pilot program to validate performance in a real-world clinical setting.

Phase 4: Full Rollout & Continuous Optimization

Gradual expansion to full departmental use, ongoing monitoring of performance, and iterative refinements based on user feedback and new data.

Transform Your Endoscopy Workflow Today

Ready to enhance reporting accuracy, reduce workload, and standardize your diagnostic processes with AI? Let's discuss how Report-Angel can revolutionize your practice.

Ready to Get Started?

Book Your Free Consultation.

Let's Discuss Your AI Strategy!

Lets Discuss Your Needs


AI Consultation Booking