Women’s Imaging: Just in Time
By Patrick Brennan, PhD
Radiology Today
Vol. 23 No. 7 P. 14
On-demand training offers a new paradigm in workforce development.
Radiologists often say that their ability to detect cancer is dependent on the quality of the mammogram. Radiology practices may take this a step further in that cancer detection rates also depend on the accuracy of the radiologists reading the mammograms.
The Mammography Quality Standards Act (MQSA) requires physicians who interpret mammography to obtain at least 15 hours of category 1 CME units in mammography every 36 months to maintain their qualifications.1
Easy access to quality CME has always been a challenge for mammographers and facilities. Even before the pandemic, facilities had begun to question the value of conferences and broad training programs. Now, with travel constraints and staffing shortages, multiday CME junkets are nearly out of the question. On-demand breast education delivers both quality improvement and workforce development benefits. This can enable the following:
• practical preemployment quality checks;
• ongoing professional development for existing staff; and
• objective skills-based evaluation for annual auditing/quality assurance reviews.
Reducing Report Variability
Breast cancer screening shows wide variability among radiologists in the interpretation of screening mammograms.2 While experience related factors, such as annual reading volume, are frequently discussed as an explanation for variability among radiologists, few studies have shown a strong relationship. According to one study, breast cancer detection rates increased with the facility’s screening mammography volume but appeared to be unrelated to the radiologist’s screening mammography volume.3
The persistent variability in reading performance has led to attempts to go beyond CME to generate improvement. An Institute of Medicine report suggested modifying the MQSA CME requirements to specifically focus on skills assessment using test sets with a mix of normal and abnormal findings. This assessment method would compare the performance of interpreting physicians with their peers to provide them with feedback on their interpretive skills and identify areas for improvement.4
More recently, results from a randomized controlled trial suggest that interpretive performance can be improved by educational interventions based on actual clinical cases with findings that are frequently misinterpreted. These findings and the observed improvements in reading performance suggest that direct interventions focused on improving the accuracy of mammography interpretation should be the highest priority for meeting CME requirements under MQSA.5
Immediate Feedback
The use of on-demand breast training has shown a 34% improvement in accuracy of diagnosing difficult cases. This on-demand training is proven to help clinicians improve their ability to detect and diagnose breast cancer cases, significantly improving outcomes for patients.
By providing immediate feedback on discrepancies between truth and actual decisions, on-demand training can be used to identify individual weaknesses and prescribe tailored education. This approach offers a cost- and time-effective way to meet CME requirements as well as accelerated learning, immediately improving outcomes for mammographers and facilities.
Preemployment Quality Checks
False readings can create unnecessary trauma for patients and put practices at risk. These risks can be reduced by making high-quality training available for staff, as well as by comparing the performance of potential hires against existing staff or target accuracy rates. With instant feedback and certification, facilities have a tool to evaluate the diagnostic accuracy of potential candidates in an objective and practical manner.
Professional Development
On-demand educational technology enables radiologists to review, in realtime, an enriched cohort of 2D mammography and digital breast tomosynthesis (3D mammography) cases with varying levels of difficulty, featuring real cases with full-resolution images using real-life reading protocols and workflow. In their own reading environment, users view cases in DICOM format and can zoom and digitally adjust the images, including panning or adjusting window width and level.
On-demand, online training packages can provide immediate feedback on reading performance, comparing the user’s classification with the pathology-verified ground truth for each case. Using several metrics, including sensitivity, specificity, true positive, true negative, false positive, and false negative scores to gauge their performance, radiologists are able to identify errors and focus future trainings on areas of need to improve performance for earlier and more accurate disease diagnoses. Upon successful completion of each training module, users receive CME credits.
Objective QA Auditing
Under MQSA, each mammography facility is required to perform a medical outcomes audit at least once every year. This audit is designed to track positive mammograms, correlate with pathology results, and review known false-negative findings. Annual audits support continuous quality improvement at the facility and individual level—they also provide a tremendous opportunity for performance feedback.
Use of real cases that include both malignant and normal cases can be an effective supplement to clinical audits for assessing radiologists’ reading level and identifying areas for improvement. With confidential benchmarking, facilities have the ability to centrally store anonymized data to allow clinicians to compare their skills at local and national levels.
Better Accuracy for Better Care
High-quality, accurate readings of mammograms are critical to the early detection of breast cancer. However, varying levels of skill and experience among radiologists can contribute to interpretation errors and variations, which can have a significant impact on patient care and outcomes. Easy access to high-quality, on-demand breast education can deliver quality improvement, workforce development, and improved outcomes for clinicians and facilities. The ultimate goal is to help radiologists diagnose breast cancer faster and more accurately, giving women worldwide a better chance of cancer survival.
— Patrick Brennan, PhD, is CEO of DetectedX and a global leader of medical imaging optimization and perception. He is chair of diagnostic imaging at the University of Sydney.
References
1. Mammography Quality Standards Act regulations. FDA website. https://www.fda.gov/radiation-emitting-products/regulations-mqsa/mammography-quality-standards-act-regulations. Updated November 29, 2017.
2. Elmore JG, Wells CK, Lee CH, Howard DH, Feinstein AR. Variability in radiologists' interpretations of mammograms. N Engl J Med. 1994;331(22):1493-1499.
3. Théberge I, Hébert-Croteau N, Langlois A, Major D, Brisson J. Volume of screening mammography and performance in the Quebec population-based Breast Cancer Screening Program. CMAJ. 2005;172(2):195-199.
4. National Research Council, Institute of Medicine, National Cancer Policy Board, Committee on Improving Mammography Quality Standards. Improving Breast Imaging Quality Standards. Washington, D.C.: National Academies Press; 2005.
5. Geller BM, Bogart A, Carney PA, et al. Educational interventions to improve screening mammography interpretation: a randomized controlled trial. AJR Am J Roentgenol. 2014;202(6):W586-W596.
