Learning Halfspaces with Malicious Noise

We give new algorithms for learning halfspaces in the challenging malicious noise model, where an adversary may corrupt both the labels and the underlying distribution of examples. Our algorithms can tolerate malicious noise rates exponentially larger than previous work in terms of the dependence on the dimension n, and succeed for the fairly broad class of all isotropic log-concave distributions. We give poly(n, 1/)-time algorithms for solving the following problems to accuracy : ? Learning origin-centered halfspaces in Rn with respect to the uniform distribution on the unit ball with malicious noise rate = (2 / log(n/)). (The best previous result was (/(n log(n/))1/4 ).) ? Learning origin-centered halfspaces with respect to any isotropic log-concave distribution on Rn with malicious noise rate = (3 / log(n/)). This is the first efficient algorithm for learning under isotropic log-concave distributions in the presence of malicious noise. We also give a poly(n, 1/)-time algorithm for...

• Type: Conference
• Year: 2009
• Where: ICALP
• Authors: Adam R. Klivans, Philip M. Long, Rocco A. Servedio
• Keywords: ICALP 2009, Isotropic Log-concave Distributions, Malicious Noise Model, Malicious Noise Rate, Theoretical Computer Science