A nonparametric procedure for comparing the areas under correlated LROC curves

Update Item Information
Publication Type pre-print
School or College <blank>
Department <blank>
Creator Wunderlich, Adam James
Other Author Noo, Frédéric
Title A nonparametric procedure for comparing the areas under correlated LROC curves
Date 2012-01-01
Description In contrast to the receiver operating characteristic (ROC) assessment paradigm, localization ROC (LROC) analysis provides a means to jointly assess the accuracy of localization and detection in an observer study. In a typical multireader, multicase (MRMC) evaluation, the data sets are paired so that correlations arise in observer performance both between readers and across the imaging conditions (e.g., reconstruction methods or scanning parameters) being compared. Therefore, MRMC evaluations motivate the need for a statistical methodology to compare correlated LROC curves. In this paper, we suggest a nonparametric strategy for this purpose. Specifically, we find that seminal work of Sen on U-statistics can be applied to estimate the covariance matrix for a vector of LROC area estimates. The resulting covariance estimator is the LROC analog of the covariance estimator given by DeLong et al. for ROC analysis. Once the covariance matrix is estimated, it can be used to construct confidence intervals and/or confidence regions for purposes of comparing observer performance across imaging conditions. In addition, given the results of a small-scale pilot study, the covariance estimator may be used to estimate the number of images and observers needed to achieve a desired confidence interval size in a full-scale observer study. The utility of our methodology is illustrated with a human-observer LROC evaluation of three image reconstruction strategies for fan-beam X-ray computed tomography.
Type Text
Publisher Institute of Electrical and Electronics Engineers (IEEE)
Volume 31
Issue 11
First Page 2050
Last Page 2061
Language eng
Bibliographic Citation Wunderlich, A., & Noo, F. (2012). A nonparametric procedure for comparing the areas under correlated LROC curves. IEEE Transactions on Medical Imaging, 31(11), 2050-61.
Rights Management (c) 2012 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Format Medium application/pdf
Format Extent 2,572,390 bytes
Identifier uspace,18292
ARK ark:/87278/s6k07p32
Setname ir_uspace
ID 708829
Reference URL https://collections.lib.utah.edu/ark:/87278/s6k07p32
Back to Search Results