Part I: Induced Ontology from a Skills Algebra
1. The Core Idea
The standard approach to ontology is declarative: you specify entities, sorts, relations, and axioms that carve up a domain. The ontology is prior to any operations.
The induced ontology approach inverts this: the algebra is prior, and the ontology is what the algebra “sees” or “generates.” This is closer to how mathematics works—we don’t declare that groups exist and then study them; we define the group axioms and discover what structures satisfy them.
For skills, the intuition is:
- We have a compositional algebra with certain axioms
- The ontology is the collection of structures, distinctions, and relations that are invariant under or induced by the algebraic operations
This is analogous to Klein’s Erlangen program: geometry is the study of invariants under a transformation group. Here, skill ontology is the study of invariants under skill composition.
2. Formal Setup
Let me establish a minimal algebraic framework and then systematically derive ontological structure from it.
Definition 1 (Skills Algebra). A skills algebra is a tuple where:
- is a set of skills
- is a composition operation
- is an identity element
- is a set of tasks
- is a fitness function
satisfying:
- Associativity:
- Identity:
- Fitness coherence: for all (the null skill solves nothing)
This makes a monoid. We don’t assume commutativity (sequential vs. parallel composition differ) or inverses (you can’t “undo” a skill).
3. Induced Ontological Structures
3.1 The Divisibility Pre-order
Definition 2. For , define:
This reads: ” divides ” or ” is a component of .”
Proposition 1. is a pre-order (reflexive and transitive) but not generally a partial order (antisymmetry may fail).
Proof. Reflexivity: , so . Transitivity: if and , then . Antisymmetry fails in general: we could have and with .
Ontological interpretation: The pre-order induces an equivalence relation:
The quotient is a poset. Elements of an equivalence class are algebraically interchangeable—they play the same compositional role. This is the algebra telling us which skills are “the same” from a structural standpoint, even if extensionally different.
3.2 The Complexity Filtration
Definition 3. For a generating set (primitive skills), define the complexity of as: with if is not expressible.
This induces a filtration: where .
Ontological interpretation: The filtration levels are ontological strata. Primitive skills () are the “atoms”; complex skills emerge at higher levels. This connects to Arora & Goyal’s emergence theory: competence on -tuples of skills corresponds to the stratum.
3.3 Task-Relative Ontology
Here’s where things get interesting. The fitness function induces a task-relative view of the ontology.
Definition 4. For threshold and task , define:
This is the set of skills that are -competent for task .
Proposition 2. If satisfies monotonicity ( for all ), then is an upper set (order filter) in .
Ontological interpretation: Different tasks “see” different subsets of the skill ontology. A task requiring complex reasoning only recognizes skills above a certain complexity threshold. The full ontology is the union:
But no single task reveals the whole ontology. This is a perspectival or task-indexed ontology.
3.4 The Galois Connection
There’s a beautiful duality between skills and tasks that deserves formalization.
Definition 5. Define: \begin{align*} \text{skills}: 2^\mathcal{T} &\to 2^\mathcal{S} \ \text{skills}(\mathcal{T}') &= {S : \phi(S, T) \geq \epsilon \text{ for all } T \in \mathcal{T}'} \end{align*}
\begin{align*} \text{tasks}: 2^\mathcal{S} &\to 2^\mathcal{T} \ \text{tasks}(\mathcal{S}') &= {T : \phi(S, T) \geq \epsilon \text{ for all } S \in \mathcal{S}'} \end{align*}
Proposition 3. forms a Galois connection between and .
Proof. We need . Both reduce to: for all , .
Ontological interpretation: The closed elements of this Galois connection—sets with —are the natural kinds of the induced ontology. They’re the skill-sets that are “carved out” by task structure. Similarly, closed task-sets are the natural task-kinds.
This gives you a formal answer to “what skills exist?”: the skills that survive the Galois closure are the ones with ontological standing.
4. Ontological Expansion as Algebraic Closure
Now we can formalize what “open-ended skill generation” means ontologically.
Definition 6. Given a skills algebra and a set of primitive skills , the generated ontology is: where and .
Proposition 4. is the smallest submonoid of containing .
Ontological expansion occurs when:
- We add new primitives:
- The generated ontology expands:
The expansion is non-trivial if —i.e., the new skill isn’t already expressible as a composition of existing primitives.
Connection to SKILL-MIX: When a model trained on -compositions suddenly exhibits competence on -compositions after scaling, this is ontological expansion driven by scaling, not by adding new primitives. The primitives were always there; what expands is the realized portion of the generated ontology.
5. The Emergence Threshold as Ontological Boundary
Combining the complexity filtration with task-relative competence:
Definition 7. The emergence boundary for task at threshold is:
This is the minimal complexity at which some skill becomes -competent for .
Ontological interpretation: Skills below the emergence boundary are “ontologically inert” for task —they exist in the algebra but don’t manifest in task performance. As models scale (per Arora & Goyal), increases, revealing more of the ontology.
The full picture:
Part II: Reconciling Mereological and Algebraic Structure
1. The Problem
You have two kinds of structure on skills:
- Mereological: Part-whole relations. “Metaphor recognition” is part of “literary analysis.”
- Algebraic: Compositional operations. “Metaphor recognition logical argumentation” produces “persuasive writing with figurative language.”
These seem related but are not identical:
- Mereology is about constitution: what is made of?
- Algebra is about combination: what does produce when combined?
A skill can be a part of another without being a compositional factor of it, and vice versa.
2. Two Partial Orders
Let’s formalize both structures.
Mereological structure: Define part-of relation :
We assume this satisfies the axioms of a partial order (reflexive, antisymmetric, transitive).
Algebraic structure: Define the divisibility relation (from Part I):
Passing to the quotient by makes this a partial order.
Question: How do and relate?
3. Four Logical Possibilities
For any pair :
| Case | Interpretation | ||
|---|---|---|---|
| A | Yes | Yes | is both a part and a factor of |
| B | Yes | No | is a part but not a compositional factor |
| C | No | Yes | is a factor but not a constitutive part |
| D | No | No | No structural relation |
Examples:
Case A: “Arithmetic” is part of “algebra” and .
Case B: “Pattern recognition” is part of “mathematical reasoning” but you can’t compose pattern recognition with something to get mathematical reasoning—it’s more like a background capacity that enables reasoning.
Case C: You can compose “summarization” with “translation” to get “cross-lingual summarization,” but summarization isn’t a part of translation or vice versa—they’re independent skills that combine.
Case D: “Cooking” and “differential geometry” have no structural relation (in typical domains).
4. A Reconciliation Framework
The key insight: mereology and algebra capture different aspects of skill structure. We need a framework that includes both.
Definition 8 (Skill Structure). A skill structure is a tuple where:
- is a poset (mereological structure)
- is a monoid (algebraic structure)
These are connected by coherence conditions.
4.1 Coherence Condition 1: Compositional Closure of Parts
Axiom (Part Composition): If and , then:
Interpretation: composing parts of gives (at most) a part of composed with itself.
This is too weak if is much bigger than . A stronger version:
Axiom (Part Composition, strong): If and , then:
This says: composing parts stays within the part-structure.
4.2 Coherence Condition 2: Algebraic Reflection of Mereology
Axiom (Mereological Reflection): If , then:
Interpretation: if is part of , then there’s some way to compose with something to get (a part of) . Mereological inclusion has algebraic consequences.
4.3 Coherence Condition 3: Joins and Compositions
If is a join-semilattice (every pair has a least upper bound ), we can ask how relates to .
Axiom (Join-Composition Distributivity):
This says composition distributes over mereological joins. It’s a strong condition—essentially making a quantale-like structure.
When this fails: Consider , , . Then might be “argumentation.” But (writing applied to argumentation) may not equal the join of “writing applied to formal logic” and “writing applied to rhetoric”—the whole exceeds the sum of parts.
5. A Geometric Picture
The reconciliation becomes clearer with a geometric metaphor.
Think of skills as living in a space with two kinds of structure:
- Vertical structure (mereological): how skills decompose into parts
- Horizontal structure (algebraic): how skills combine to form new skills
S₁ ∘ S₂ ∘ S₃ (complex composite)
↑ composition
S₁ ∘ S₂ ←——————→ S₂ ∘ S₃
↑ ↑
S₁ ←——————→ S₂ ←——————→ S₃ (primitive level)
| | |
↓ ↓ ↓
parts parts parts (mereological decomposition)
of S₁ of S₂ of S₃
Mereology moves down (decomposition) or up (integration within a skill). Algebra moves horizontally (composition across skills).
The coherence conditions constrain how vertical and horizontal movements interact—you can’t have a structure where mereological parts compose to something outside the mereological envelope.
6. A Categorical Formulation
For maximum precision, here’s a categorical version.
Definition 9. A mereological monoid is a category where:
- Objects are skills
- Morphisms are “part-of” witnesses (proofs that )
- There’s a monoidal structure on objects (composition)
- The monoidal structure is functorial with respect to morphisms
The functoriality condition says: if and are part-of witnesses, then there’s a canonical witness .
Interpretation: Composition respects part-of structure. If is part of and is part of , then is part of .
This is a monoidal poset (a poset with compatible monoidal structure), which is a well-studied structure in categorical algebra.
7. Practical Implications
7.1 For Skill Extraction
When extracting skills from text or model behavior, you’re discovering both:
- Mereological structure: which skills are constitutive of which
- Algebraic structure: which skills combine productively
These require different methods:
- Mereology: factor analysis, hierarchical clustering, asking “what does this skill presuppose?”
- Algebra: composition experiments (SKILL-MIX style), asking “what happens when we combine these?“
7.2 For Skill Evaluation
Your fitness function can be decomposed:
The interaction term captures non-mereological emergence—cases where composition produces capabilities beyond the sum of parts.
7.3 For Metaskill Definition
Metaskills operate on both structures:
- Decomposition metaskill (): exploits mereological structure to break skills into parts
- Composition metaskill (): exploits algebraic structure to combine skills
- Analysis metaskill (): reads the fitness function to evaluate task-skill fit
A complete metaskill theory needs to specify how metaskills interact with both mereological and algebraic structure.
8. Revised Ontological Picture
Putting Parts I and II together:
┌─────────────────────────────────────┐
│ SKILLS ALGEBRA │
│ (𝒮, ∘, 𝟙) — monoid structure │
└─────────────────────────────────────┘
│
┌───────────────┼───────────────┐
▼ ▼ ▼
┌──────────────┐ ┌──────────────┐ ┌──────────────┐
│ Divisibility │ │ Complexity │ │ Task-Relative│
│ Pre-order │ │ Filtration │ │ Ontology │
│ (⊴ₐ) │ │ (𝒮≤n) │ │ (𝒮ᵀᵋ) │
└──────────────┘ └──────────────┘ └──────────────┘
│ │ │
└───────────────┼───────────────┘
▼
┌─────────────────────────────────────┐
│ INDUCED ONTOLOGY │
│ (natural kinds via Galois closure) │
└─────────────────────────────────────┘
│
┌───────────────┴───────────────┐
▼ ▼
┌──────────────┐ ┌──────────────┐
│ Mereological │◄── coherence ─►│ Algebraic │
│ Structure │ conditions │ Structure │
│ (⊑ₘ) │ │ (⊴ₐ) │
└──────────────┘ └──────────────┘
│ │
└───────────────┬───────────────┘
▼
┌─────────────────────────────────────┐
│ SKILL STRUCTURE │
│ (𝒮, ⊑ₘ, ∘, 𝟙) — monoidal poset │
└─────────────────────────────────────┘
Summary of Key Formal Constructs
| Construct | Definition | Role |
|---|---|---|
| Skills monoid | Associative composition with identity | Generative engine |
| Divisibility | Algebraic order | |
| Complexity | Minimal composition length from primitives | Stratification |
| Task-relative set | Perspectival ontology | |
| Galois connection | Natural kinds | |
| Mereological order | Part-whole relation | Constitutional structure |
| Monoidal poset | Poset with compatible monoid | Unified structure |
| Coherence conditions | Axioms relating and | Structural harmony |