Practical use of receiver operating characteristic analysis to assess the performances of defect detection algorithms

Defect detection in images is a current task in quality control and is often integrated in partially or fully automated systems. Assessing the performances of defect detection algorithms is thus of great interest. However, because this is application- and context-dependent, it remains a difficult task. We describe a methodology to measure the performances of such algorithms on large images in a semi-automated defect inspection situation. Considering standard problems occurring in real cases, we compare typical performance evaluation methods. This analysis leads to the construction of a simple and practical receiver operating characteristic (ROC) based method. This method extends the pixel-level ROC analysis to an object-based approach by dilating the ground truth and the set of detected pixels before calculating the true-positive and false-positive rates. These dilations are computed thanks to the a priori knowledge of a human-defined ground truth and gives to true-positive and false-p...

• Type: Journal
• Year: 2008
• Where: JEI
• Authors: Yann Le Meur, Jean-Michel Vignolle, Jocelyn Chanussot
• Keywords: False-positive Rates, Ground Truth, JEI 2006, JEI 2008, Semi-automated Defect Inspection