Validation methods for calibrating software effort models

COCONUT calibrates effort estimation models using an exhaustive search over the space of calibration parameters in a COCOMO I model. This technique is much simpler than other effort estimation method yet yields PRED levels comparable to those other methods. Also, it does so with less project data and fewer attributes (no scale factors). However, a comparison between COCONUT and other methods is complicated by differences in the experimental methods used for effort estimation. A review of those experimental methods concludes that software effort estimation models should be calibrated to local data using incremental holdout (not jack knife) studies, combined with randomization and hypothesis testing, repeated a statistically significant number of times. Categories and Subject Descriptors D.2.9 [Software Engineering]: Time Estimation; K.6.3 [Software Management]: Software Process General Terms Management, measurement, economics, experimentation Keywords COCOMO, calibration, incremental c...

• Type: Conference
• Year: 2005
• Where: ICSE
• Authors: Tim Menzies, Daniel Port, Zhihao Chen, Jairus Hihn, Sherry Stukes
• Keywords: Effort Estimation Method, Effort Estimation Models, ICSE 2005, Software Effort Estimation, Software Engineering