3 Point Forward ← Back to 3 Point Forward
SophiaXT Research

Routing intelligence over the shape of knowledge

A compositional language model that routes computation over the structure of information — its attributes and relations — instead of the order of words. And it layers onto the databases you already have, with no specialist model to train.

Every language model you have ever used reads the world in a straight line. It predicts the next word from the words before it — intelligence as a function of sequence. That works astonishingly well until the moment you ask it to hold a lot of context at once, reason across it, and recombine ideas it never saw stitched together. Then it frays. Retrieval starts handing back the merely similar instead of the actually relevant, and accuracy quietly falls off a cliff.

SophiaXT has spent that failure looking for a different axis. The bet is simple to state and hard to earn: process information by its shape, not its sequence. Rank and route the pieces of a problem by the structure they form — which facts bridge clusters, which anchor an answer, how attributes and relations connect — and let understanding condense out of that structure the way signal separates from noise.

The one thing no one else was doing

Topology — the study of shape and connection — is not new to AI. Researchers have used it for years to observe what a model is doing: to diagnose, to visualize, to explain after the fact. What no one had done was let the model route on it. Every prior use of topological structure in language models is diagnostic. SophiaXT’s is load-bearing — the shape of the knowledge becomes an input to the computation itself.

Concretely: instead of representing a document as a stream of subword tokens, a Compositional Language Model represents it as loci — atomic units carrying typed attributes and relations, placed on a lattice of concepts. Each locus gets a score built from two honest, countable things: how many attributes and relations it carries, and its local topological entropy — a measure of whether it sits at the boundary between clusters (a bridge) or settled deep inside one (a core). Context is then ordered so it flows from high-entropy, scene-setting bridges down to low-entropy, answer-anchoring cores. Chronology — the order things happened to arrive — is demoted to a tie-breaker.

“Process information topologically over chronologically. Let it condense from high-entropy to low-entropy states, the way noise diffuses into signal.”

What the data already says

None of this would matter if it were only elegant. The discipline SophiaXT holds itself to is falsification: preregister the test, hash the data before the run, and let the numbers kill the idea if they can. Under that discipline, the core claim held.

By the numbers — measured, not projected
+20 pts
accuracy from routing context topologically instead of by relevance, exactly where large-context retrieval degrades
73.3% vs 53.3% · K=3→30 · TinyLlama-1.1B
1.00 vs 0.15
compositional generalization to combinations the model never trained on, versus a matched transformer
attribute-routing · 4/4 seeds
1.67×
out-of-distribution generalization from anchor-token masking, causally isolated to specific projections
95% CI [1.51×, 1.85×] · n=48
1.82×
token efficiency at equal grounding from compositional memory versus retrieval-augmented generation
at parity grounding

The headline result is the +20 points. As you push more context into a model, ordering it by raw similarity gets worse — the relevant drowns in the similar. Ordering it topologically held steady while relevance collapsed. That is the exact place conventional AI breaks, and it is the place this approach is strongest.

Killed by our own tests

What earns trust here is not the wins — it’s the losses SophiaXT published alongside them. Three of the lab’s own ideas went into the same falsification machine and did not come out:

What remains, remains because the data refused to break it. Three ideas killed by their own author is not a weakness in the story — it is the reason to believe the rest of it.

How it flies onto what you already run

Here is the part that matters for a business, not just a paper. This is not a new foundation model you have to train. The topological ordering is computed at inference time — it runs on artifacts that already exist. In practice it is a thin routing-and-ordering layer that sits on top of a frozen base and the vector database you already have.

So the deployment story is unusually clean: keep your existing data layers, keep your existing store, and add the layer that routes over their structure. No specialist model per problem. No re-embedding the world. A graph of attributes and relations laid over the data you already collected, turning a flat vector store into something that can be reasoned across. That is how SophiaXT takes lab research and puts it to work inside a real company’s stack — and it is exactly the edge 3 Point Forward deploys for the businesses it builds with.

Keep your database. Add the layer that understands its shape.

The honest frontier

The measured results above are real and replicated at small scale, on a single consumer GPU. The open question — the one SophiaXT is transparent about — is whether the compositional edge holds, or grows, as the models get larger. The lab’s answer is not a promise; it is a program: scale the falsification, not the hype, under the same preregistered discipline that already retired the lattice and the entropy-only router. If the edge holds, it is a genuine architectural advantage. If it doesn’t, the same rigor kills it fast and says so.

Either way, the data decides. That is a rare thing to be able to write about one’s own research — and it is the whole point.