Ontological Expansion
Definition
Ontological expansion is the process by which the skill ontology grows through composition or discovery of new skills.
Mechanisms
1. Compositional Closure
Given primitives , the generated ontology is:
Expansion occurs when new primitives are added:
2. Scale-Dependent Realization
Following Arora & Goyal, skill compositions only become “real” past certain thresholds:
- Algebraic ontology: All possible compositions
- Realized ontology: Skills with for some task
- Emergent ontology: Skills within model’s current emergence boundary
3. Automated Discovery
Per ACD, models can discover new skills through self-exploration.
In This Project
Three Levels
Algebraic ontology: ⟨𝒮₀⟩ (all possible compositions)
↓ (filter by task competence)
Realized ontology: ⋃ₜ 𝒮ₜᵋ (skills with nonzero fitness)
↓ (filter by model scale)
Emergent ontology: {S : λ(S) ≤ λ*} ∩ ⋃ₜ 𝒮ₜᵋ
Constraints on Growth
- Finite generation: for finite
- Bounded by domain: Fitness threshold filters meaningless compositions
- Emergence thresholds: Scale determines which compositions manifest
Connection to SKILL-MIX
For skill set size and composition degree , there are potential compositions, but models only exhibit competence on a subset. The realized ontology ⊂ algebraic ontology.
Related Concepts
- ontology — What expands
- skills-algebra — The algebraic structure
- emergence — Scale-dependent expansion
- scaling-laws — What drives expansion