Proposal and validation of a method to construct confidence intervals for clinical outcomes around FROC curves for mammography CAD systems
2005 (English)In: MEDICAL IMAGING 2005: IMAGE PROCESSING, PT 1-3 / [ed] itzpatrick, JM; Reinhardt, JM, BELLINGHAM: SPIE-INT SOC OPTICAL ENGINEERING , 2005, Vol. 5747, 675-682 p.Conference paper (Refereed)
This paper introduces a method for constructing confidence intervals for possible clinical outcomes around the FROC curve of a mammography CAD system. Given the architecture of a CAD classifying machine, there is one and only one system threshold that will yield a desired sensitivity on a certain population. The limited training sample size leads to a sampling error and an uncertainty in determining the optimal system threshold. This leads to an uncertainty in the operating point in the direction along the FROC curve which can be captured by a Bayesian approach where the distribution of possible thresholds is estimated. This uncertainty contributes to a large and spread-out confidence interval which is important to consider when one is intending to make comparisons between CAD algorithms trained on different data sets. The method is validated using a Monte Carlo method designed to capture the effect of correctly determining the system threshold.
Place, publisher, year, edition, pages
BELLINGHAM: SPIE-INT SOC OPTICAL ENGINEERING , 2005. Vol. 5747, 675-682 p.
, Proceedings of SPIE, ISSN 277-786X ; 5747
FROC; CAD; confidence interval; operating point determination; mammography
Atom and Molecular Physics and Optics
IdentifiersURN: urn:nbn:se:kth:diva-43010DOI: 10.1117/12.593735ISI: 000230109600068ScopusID: 2-s2.0-23844505666ISBN: 0-8194-5721-3OAI: oai:DiVA.org:kth-43010DiVA: diva2:447723
Medical Imaging 2005 Conference. San Diego, CA. FEB 15-17, 2005
QC 201110132011-10-132011-10-132011-10-13Bibliographically approved