A Critique of the Valiant Model

This paper considers the Valiant framework as it is applied to the task of learning logical concepts from random examples. It is argued that the current interpretation of this Valiant model departs from common sense and practical experience in a number of ways: it does not allow sample dependent bounds, it uses a worst case rather than an average case analysis, and it does not accommodate preferences about hypotheses. It is claimed that as a result, the current model can produce overlyconservative estimates of confidence and can fail to model the logical induction process as it is often implemented. A Bayesian approach is developed, based on the sample dependent notion of disagreement between consistent hypotheses. This approach seems to overcome the indicated problems. 1 I n t r o d u c t i o n The field of machine learning has accrued experience across a broad number of areas, and there is now a push for developing a more formal theory of learning. While we are still a long way from...

• Type: Conference
• Year: 1989
• Where: IJCAI
• Authors: Wray L. Buntine
• Keywords: IJCAI 1989, IJCAI 2007, Valiant, Valiant Model, Valiant Model Departs