Training set optimization and classifier performance in a top-down diabetic retinopathy screening system

J. Wigdahl; C. Agurto; V. Murray; S. Barriga; P. Soliz

doi:10.1117/12.2007931

18 March 2013 Training set optimization and classifier performance in a top-down diabetic retinopathy screening system

J. Wigdahl, C. Agurto, V. Murray, S. Barriga, P. Soliz

Proceedings Volume 8670, Medical Imaging 2013: Computer-Aided Diagnosis; 86702K (2013) https://doi.org/10.1117/12.2007931
Event: SPIE Medical Imaging, 2013, Lake Buena Vista (Orlando Area), Florida, United States

Abstract

Diabetic retinopathy (DR) affects more than 4.4 million Americans age 40 and over. Automatic screening for DR has shown to be an efficient and cost-effective way to lower the burden on the healthcare system, by triaging diabetic patients and ensuring timely care for those presenting with DR. Several supervised algorithms have been developed to detect pathologies related to DR, but little work has been done in determining the size of the training set that optimizes an algorithm’s performance. In this paper we analyze the effect of the training sample size on the performance of a top-down DR screening algorithm for different types of statistical classifiers. Results are based on partial least squares (PLS), support vector machines (SVM), k-nearest neighbor (kNN), and Naïve Bayes classifiers. Our dataset consisted of digital retinal images collected from a total of 745 cases (595 controls, 150 with DR). We varied the number of normal controls in the training set, while keeping the number of DR samples constant, and repeated the procedure 10 times using randomized training sets to avoid bias. Results show increasing performance in terms of area under the ROC curve (AUC) when the number of DR subjects in the training set increased, with similar trends for each of the classifiers. Of these, PLS and k-NN had the highest average AUC. Lower standard deviation and a flattening of the AUC curve gives evidence that there is a limit to the learning ability of the classifiers and an optimal number of cases to train on.

Citation Download Citation

J. Wigdahl, C. Agurto, V. Murray, S. Barriga, and P. Soliz "Training set optimization and classifier performance in a top-down diabetic retinopathy screening system", Proc. SPIE 8670, Medical Imaging 2013: Computer-Aided Diagnosis, 86702K (18 March 2013); https://doi.org/10.1117/12.2007931

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available