Learning Coherent Concepts

We develop a theory for learning scenarios where multiple learners co-exist but there are mutual compatibility constraints on their outcomes. This is natural in cognitive learning situations, where “natural” compatibility constraints are imposed on the outcomes of classifiers so that a valid sentence, image or any other domain representation is produced. We suggest that work in this direction may help to resolve the contrast between the hardness of learning as predicted by the current theoretical models and the apparent ease at which cognitive systems seem to learn. A model of concept learning is studied in which the target concept is required to cohere with other concepts of interest. The coherency is expressed via a (Boolean) constraint that the concepts have to satisfy. Under this model, learning a concept is shown to be easier (in terms of sample complexity and mistake bounds) and the concepts learned are shown to be more robust to noise in their input (attribute noise). Thes...

• Type: Conference
• Year: 2001
• Where: ALT
• Authors: Ashutosh Garg, Dan Roth
• Keywords: ALT 2001, Cognitive Learning Situations, Compatibility Constraints, Mutual Compatibility Constraints