Challenges with Verification, Repeatability, and Meaningful Comparison in Genetic Programming: Gibson's Magic

This paper examines some of the reporting and research practices concerning empirical work in genetic programming. We describe several common loopholes and offer three case studies—two in data modeling and one in robotics—that illustrate each. We show that by exploiting these loopholes, one can achieve performance gains of up two orders of magnitude without any substantiative changes to GP. We subsequently offer several recommendations.

• Type: Conference
• Year: 1999
• Where: GECCO
• Authors: Jason M. Daida, Derrick S. Ampy, Michael Ratanasavetavadhana, Hsiaolei Li, Omar A. Chaudhri
• Keywords: Common Loopholes, Empirical Work, GECCO 1999, Genetic Programming, Optimization