StAR: a simple tool for the statistical comparison of ROC curves

Background: As in many different areas of science and technology, most important problems in bioinformatics rely on the proper development and assessment of binary classifiers. A generalized assessment of the performance of binary classifiers is typically carried out through the analysis of their receiver operating characteristic (ROC) curves. The area under the ROC curve (AUC) constitutes a popular indicator of the performance of a binary classifier. However, the assessment of the statistical significance of the difference between any two classifiers based on this measure is not a straightforward task, since not many freely available tools exist. Most existing software is either not free, difficult to use or not easy to automate when a comparative assessment of the performance of many binary classifiers is intended. This constitutes the typical scenario for the optimization of parameters when developing new classifiers and also for their performance validation through the comparison ...

• Type: Journal
• Year: 2008
• Where: BMCBI
• Authors: Ismael A. Vergara, Tomás Norambuena, Evandro Ferrada, Alex W. Slater, Francisco Melo
• Keywords: Assessment, Binary Classifiers, BMCBI 2008, Software