Formal Learning Theory Kernel: Blueprint v1

2.2 The concept class

Definition 2.3 Concept Class

Lean: ConceptClass

A concept class \(\mathcal{C} \subseteq Y^X\) is a collection of concepts over a common domain. The class is the primary object of study: every major question in learning theory is a question about concept classes.

The concept class is the node every complexity measure in the book connects to: VC dimension, Littlestone dimension, Rademacher complexity, covering number, growth function, mind-change dimension. It is the object whose structure determines what is learnable.