A Complete Characterization of Statistical Query Learning with Applications to Evolvability

Statistical query (SQ) learning model of Kearns is a natural restriction of the PAC learning model in which a learning algorithm is allowed to obtain estimates of statistical properties of the examples but cannot see the examples themselves [18]. We describe a new and simple characterization of the query complexity of learning in the SQ learning model. Unlike the previously known bounds on SQ learning [7, 9, 33, 3, 28] our characterization preserves the accuracy and the efficiency of learning. The preservation of accuracy implies that that our characterization gives the first characterization of SQ learning in the agnostic learning framework of Haussler and Kearns, Schapire and Sellie [15, 20]. The preservation of efficiency allows us to derive a new technique for the design of evolutionary algorithms in Valiant’s model of evolvability [32]. We use this technique to demonstrate the existence of a large class of monotone evolutionary learning algorithms based on square loss fitness...

• Type: Conference
• Year: 2009
• Where: FOCS
• Authors: Vitaly Feldman
• Keywords: FOCS 2009, Learning Algorithms, PAC Learning Model, SQ Learning Model, Theoretical Computer Science