Part I: Induced Ontology from a Skills Algebra

1. The Core Idea

The standard approach to ontology is declarative: you specify entities, sorts, relations, and axioms that carve up a domain. The ontology is prior to any operations.

The induced ontology approach inverts this: the algebra is prior, and the ontology is what the algebra “sees” or “generates.” This is closer to how mathematics works—we don’t declare that groups exist and then study them; we define the group axioms and discover what structures satisfy them.

For skills, the intuition is:

  • We have a compositional algebra with certain axioms
  • The ontology is the collection of structures, distinctions, and relations that are invariant under or induced by the algebraic operations

This is analogous to Klein’s Erlangen program: geometry is the study of invariants under a transformation group. Here, skill ontology is the study of invariants under skill composition.

2. Formal Setup

Let me establish a minimal algebraic framework and then systematically derive ontological structure from it.

Definition 1 (Skills Algebra). A skills algebra is a tuple where:

  • is a set of skills
  • is a composition operation
  • is an identity element
  • is a set of tasks
  • is a fitness function

satisfying:

  1. Associativity:
  2. Identity:
  3. Fitness coherence: for all (the null skill solves nothing)

This makes a monoid. We don’t assume commutativity (sequential vs. parallel composition differ) or inverses (you can’t “undo” a skill).

3. Induced Ontological Structures

3.1 The Divisibility Pre-order

Definition 2. For , define:

This reads: ” divides ” or ” is a component of .”

Proposition 1. is a pre-order (reflexive and transitive) but not generally a partial order (antisymmetry may fail).

Proof. Reflexivity: , so . Transitivity: if and , then . Antisymmetry fails in general: we could have and with .

Ontological interpretation: The pre-order induces an equivalence relation:

The quotient is a poset. Elements of an equivalence class are algebraically interchangeable—they play the same compositional role. This is the algebra telling us which skills are “the same” from a structural standpoint, even if extensionally different.

3.2 The Complexity Filtration

Definition 3. For a generating set (primitive skills), define the complexity of as: with if is not expressible.

This induces a filtration: where .

Ontological interpretation: The filtration levels are ontological strata. Primitive skills () are the “atoms”; complex skills emerge at higher levels. This connects to Arora & Goyal’s emergence theory: competence on -tuples of skills corresponds to the stratum.

3.3 Task-Relative Ontology

Here’s where things get interesting. The fitness function induces a task-relative view of the ontology.

Definition 4. For threshold and task , define:

This is the set of skills that are -competent for task .

Proposition 2. If satisfies monotonicity ( for all ), then is an upper set (order filter) in .

Ontological interpretation: Different tasks “see” different subsets of the skill ontology. A task requiring complex reasoning only recognizes skills above a certain complexity threshold. The full ontology is the union:

But no single task reveals the whole ontology. This is a perspectival or task-indexed ontology.

3.4 The Galois Connection

There’s a beautiful duality between skills and tasks that deserves formalization.

Definition 5. Define: \begin{align*} \text{skills}: 2^\mathcal{T} &\to 2^\mathcal{S} \ \text{skills}(\mathcal{T}') &= {S : \phi(S, T) \geq \epsilon \text{ for all } T \in \mathcal{T}'} \end{align*}

\begin{align*} \text{tasks}: 2^\mathcal{S} &\to 2^\mathcal{T} \ \text{tasks}(\mathcal{S}') &= {T : \phi(S, T) \geq \epsilon \text{ for all } S \in \mathcal{S}'} \end{align*}

Proposition 3. forms a Galois connection between and .

Proof. We need . Both reduce to: for all , .

Ontological interpretation: The closed elements of this Galois connection—sets with —are the natural kinds of the induced ontology. They’re the skill-sets that are “carved out” by task structure. Similarly, closed task-sets are the natural task-kinds.

This gives you a formal answer to “what skills exist?”: the skills that survive the Galois closure are the ones with ontological standing.

4. Ontological Expansion as Algebraic Closure

Now we can formalize what “open-ended skill generation” means ontologically.

Definition 6. Given a skills algebra and a set of primitive skills , the generated ontology is: where and .

Proposition 4. is the smallest submonoid of containing .

Ontological expansion occurs when:

  1. We add new primitives:
  2. The generated ontology expands:

The expansion is non-trivial if —i.e., the new skill isn’t already expressible as a composition of existing primitives.

Connection to SKILL-MIX: When a model trained on -compositions suddenly exhibits competence on -compositions after scaling, this is ontological expansion driven by scaling, not by adding new primitives. The primitives were always there; what expands is the realized portion of the generated ontology.

5. The Emergence Threshold as Ontological Boundary

Combining the complexity filtration with task-relative competence:

Definition 7. The emergence boundary for task at threshold is:

This is the minimal complexity at which some skill becomes -competent for .

Ontological interpretation: Skills below the emergence boundary are “ontologically inert” for task —they exist in the algebra but don’t manifest in task performance. As models scale (per Arora & Goyal), increases, revealing more of the ontology.

The full picture:


Part II: Reconciling Mereological and Algebraic Structure

1. The Problem

You have two kinds of structure on skills:

  1. Mereological: Part-whole relations. “Metaphor recognition” is part of “literary analysis.”
  2. Algebraic: Compositional operations. “Metaphor recognition logical argumentation” produces “persuasive writing with figurative language.”

These seem related but are not identical:

  • Mereology is about constitution: what is made of?
  • Algebra is about combination: what does produce when combined?

A skill can be a part of another without being a compositional factor of it, and vice versa.

2. Two Partial Orders

Let’s formalize both structures.

Mereological structure: Define part-of relation :

We assume this satisfies the axioms of a partial order (reflexive, antisymmetric, transitive).

Algebraic structure: Define the divisibility relation (from Part I):

Passing to the quotient by makes this a partial order.

Question: How do and relate?

3. Four Logical Possibilities

For any pair :

CaseInterpretation
AYesYes is both a part and a factor of
BYesNo is a part but not a compositional factor
CNoYes is a factor but not a constitutive part
DNoNoNo structural relation

Examples:

Case A: “Arithmetic” is part of “algebra” and .

Case B: “Pattern recognition” is part of “mathematical reasoning” but you can’t compose pattern recognition with something to get mathematical reasoning—it’s more like a background capacity that enables reasoning.

Case C: You can compose “summarization” with “translation” to get “cross-lingual summarization,” but summarization isn’t a part of translation or vice versa—they’re independent skills that combine.

Case D: “Cooking” and “differential geometry” have no structural relation (in typical domains).

4. A Reconciliation Framework

The key insight: mereology and algebra capture different aspects of skill structure. We need a framework that includes both.

Definition 8 (Skill Structure). A skill structure is a tuple where:

  • is a poset (mereological structure)
  • is a monoid (algebraic structure)

These are connected by coherence conditions.

4.1 Coherence Condition 1: Compositional Closure of Parts

Axiom (Part Composition): If and , then:

Interpretation: composing parts of gives (at most) a part of composed with itself.

This is too weak if is much bigger than . A stronger version:

Axiom (Part Composition, strong): If and , then:

This says: composing parts stays within the part-structure.

4.2 Coherence Condition 2: Algebraic Reflection of Mereology

Axiom (Mereological Reflection): If , then:

Interpretation: if is part of , then there’s some way to compose with something to get (a part of) . Mereological inclusion has algebraic consequences.

4.3 Coherence Condition 3: Joins and Compositions

If is a join-semilattice (every pair has a least upper bound ), we can ask how relates to .

Axiom (Join-Composition Distributivity):

This says composition distributes over mereological joins. It’s a strong condition—essentially making a quantale-like structure.

When this fails: Consider , , . Then might be “argumentation.” But (writing applied to argumentation) may not equal the join of “writing applied to formal logic” and “writing applied to rhetoric”—the whole exceeds the sum of parts.

5. A Geometric Picture

The reconciliation becomes clearer with a geometric metaphor.

Think of skills as living in a space with two kinds of structure:

  • Vertical structure (mereological): how skills decompose into parts
  • Horizontal structure (algebraic): how skills combine to form new skills
                        S₁ ∘ S₂ ∘ S₃ (complex composite)
                             ↑ composition
                    S₁ ∘ S₂ ←——————→ S₂ ∘ S₃
                       ↑                ↑
                      S₁ ←——————→ S₂ ←——————→ S₃  (primitive level)
                       |         |         |
                       ↓         ↓         ↓
                    parts     parts     parts    (mereological decomposition)
                    of S₁     of S₂     of S₃

Mereology moves down (decomposition) or up (integration within a skill). Algebra moves horizontally (composition across skills).

The coherence conditions constrain how vertical and horizontal movements interact—you can’t have a structure where mereological parts compose to something outside the mereological envelope.

6. A Categorical Formulation

For maximum precision, here’s a categorical version.

Definition 9. A mereological monoid is a category where:

  • Objects are skills
  • Morphisms are “part-of” witnesses (proofs that )
  • There’s a monoidal structure on objects (composition)
  • The monoidal structure is functorial with respect to morphisms

The functoriality condition says: if and are part-of witnesses, then there’s a canonical witness .

Interpretation: Composition respects part-of structure. If is part of and is part of , then is part of .

This is a monoidal poset (a poset with compatible monoidal structure), which is a well-studied structure in categorical algebra.

7. Practical Implications

7.1 For Skill Extraction

When extracting skills from text or model behavior, you’re discovering both:

  • Mereological structure: which skills are constitutive of which
  • Algebraic structure: which skills combine productively

These require different methods:

  • Mereology: factor analysis, hierarchical clustering, asking “what does this skill presuppose?”
  • Algebra: composition experiments (SKILL-MIX style), asking “what happens when we combine these?“

7.2 For Skill Evaluation

Your fitness function can be decomposed:

The interaction term captures non-mereological emergence—cases where composition produces capabilities beyond the sum of parts.

7.3 For Metaskill Definition

Metaskills operate on both structures:

  • Decomposition metaskill (): exploits mereological structure to break skills into parts
  • Composition metaskill (): exploits algebraic structure to combine skills
  • Analysis metaskill (): reads the fitness function to evaluate task-skill fit

A complete metaskill theory needs to specify how metaskills interact with both mereological and algebraic structure.

8. Revised Ontological Picture

Putting Parts I and II together:

                    ┌─────────────────────────────────────┐
                    │         SKILLS ALGEBRA              │
                    │    (𝒮, ∘, 𝟙) — monoid structure     │
                    └─────────────────────────────────────┘
                                    │
                    ┌───────────────┼───────────────┐
                    ▼               ▼               ▼
            ┌──────────────┐ ┌──────────────┐ ┌──────────────┐
            │ Divisibility │ │  Complexity  │ │ Task-Relative│
            │  Pre-order   │ │  Filtration  │ │   Ontology   │
            │    (⊴ₐ)      │ │   (𝒮≤n)      │ │   (𝒮ᵀᵋ)      │
            └──────────────┘ └──────────────┘ └──────────────┘
                    │               │               │
                    └───────────────┼───────────────┘
                                    ▼
                    ┌─────────────────────────────────────┐
                    │      INDUCED ONTOLOGY               │
                    │  (natural kinds via Galois closure) │
                    └─────────────────────────────────────┘
                                    │
                    ┌───────────────┴───────────────┐
                    ▼                               ▼
            ┌──────────────┐                ┌──────────────┐
            │ Mereological │◄── coherence ─►│  Algebraic   │
            │  Structure   │    conditions  │  Structure   │
            │    (⊑ₘ)      │                │    (⊴ₐ)      │
            └──────────────┘                └──────────────┘
                    │                               │
                    └───────────────┬───────────────┘
                                    ▼
                    ┌─────────────────────────────────────┐
                    │     SKILL STRUCTURE                 │
                    │  (𝒮, ⊑ₘ, ∘, 𝟙) — monoidal poset     │
                    └─────────────────────────────────────┘

Summary of Key Formal Constructs

ConstructDefinitionRole
Skills monoid Associative composition with identityGenerative engine
Divisibility Algebraic order
Complexity Minimal composition length from primitivesStratification
Task-relative set Perspectival ontology
Galois connectionNatural kinds
Mereological order Part-whole relationConstitutional structure
Monoidal poset Poset with compatible monoidUnified structure
Coherence conditionsAxioms relating and Structural harmony