Category · Axis I

Research

Papers, A/B results, and what we disproved.

08 · MEASURING YOUR OWN SYSTEMA 200 carrying ok:false

Before rewriting our research, we probed every read tool by content, not by HTTP status. Thirty-odd tools worked. Four defects surfaced, one of which was not a defect: we had reported a number without reading the design behind it.

1 Nov 2026
08 · MEASURING YOUR OWN SYSTEMA system must first see itself

For three and a half hours our agent layer recorded none of five local-model runs. A network sensor that knows nothing about agents recorded all five, to the minute. Self-report was not wrong. It was absent, and absence reads as 'nothing happened'.

1 Nov 2026
08 · MEASURING YOUR OWN SYSTEMHow we report

Every figure on this site comes from a running system. The standard, the time it failed us by a factor of eighteen, and where the numbers come from.

1 Nov 2026
01 · RETRIEVAL THAT WORKSMultilingual on paper: Slovak questions fail 2.75× more often

Our embedder and both rerankers we tested are sold as multilingual. Measured with paired Slovak and English queries, Slovak failed 55% of the time against 20%, and a cross-encoder gave three different documents the identical score.

1 Nov 2026
02 · MEMORY ARCHITECTURERepetition is the mother of wisdom, not wisdom itself

Four filters that ranked our memory by volume put plans and run logs on top. Measuring novelty instead put them at the bottom, where they belong. Then the criterion hit a wall: our register of known concepts was a list of filenames.

1 Nov 2026
08 · MEASURING YOUR OWN SYSTEMRight content, wrong source: how a local model chooses what to cite

Una gave the correct physics and cited the encyclopedia instead of the primary paper sitting next to it. Four hypotheses, each tested by changing one variable. She does not pick the most authoritative source. She cites the one whose wording she reused.

1 Nov 2026
01 · RETRIEVAL THAT WORKSSearch is retrosynthesis

Retrieval finds the nearest item. Search composes an answer from parts, the way a chemist plans a molecule backwards from what is on the shelf. The map we took from the chemistry, and what it changes in an agent.

1 Nov 2026
09 · PHYTOAn organic memory returns the statement, not the file

The first A/B that actually queried both sides. The document store returns a filename. The organic memory returns the sentence that answers. Plus the bug that held 38% of every answer hostage.

1 Nov 2026
08 · MEASURING YOUR OWN SYSTEMThe test that measured a setting production never uses

Two passing evaluations in one day, both blind to the change they were meant to judge. What they missed, and the rule we took from it.

1 Nov 2026
08 · MEASURING YOUR OWN SYSTEMTwo vision models invented the same dock

A paid vision model listed ten apps that do not exist. Our local model counted fourteen icons where there were eleven. Both were wrong about the same 12-pixel detail, and chasing it found a real bug nobody would have seen.

1 Nov 2026
09 · PHYTOValues answered a question that no fact could

Three probe runs against our organic memory, each with a baseline written before the first question. A fact used without a search, a safety reflex that talked over the values, a count answered with a page size, and a 'fabrication' that turned out to be ours.

1 Nov 2026
01 · RETRIEVAL THAT WORKSWhen the biology buried the exact name

Ask our memory for a record by its own name: 93% rank-1 on plain semantic search, 43% after the biological rescore. Why a smarter score lost the easiest query, and the fix we chose.

1 Nov 2026