Files
Maven/docs/evals/2026-08-13-personal-boundary-neighbourhood.md
T
claude 8015fdbb79 Harden semantic boundaries and repair dialogue state
Replace nearest-neighbour personal routing with a frozen class-balanced linear head measured on historical, stratified, cross-validation, holdout, and fresh challenge gates (V-702). Close the four repair handoff holes, preserve nested clarification flows, and route Russian possession statements through structural grammar rather than lexical exceptions (V-573). Owner explicitly requested direct commits to master.
2026-08-13 03:00:31 +04:00

2.3 KiB

Three neighbours keep a public noun from opening the personal boundary

Measured 2026-08-13 on homesrv from master at 56254a5 plus the V-702 working tree. Embedder: quantized multilingual-e5-small through ONNX Runtime 1.26.0. Command:

make t PKG=./cmd/mavend/ RUN=TestONNXPersonalBoundary V=1 RACE=0
make t PKG=./cmd/mavend/ RUN=TestONNXTopics V=1 RACE=0

This supersedes 2026-08-03-personal-boundary.md for the boundary score. That file remains the measurement of why possession markers were replaced.

Defect

The boundary used the best cosine on each side: one-nearest-neighbour classification. Its world class correctly includes narrative questions such as расскажи про байкал, while its personal class includes remembered-speech questions. The held-out я рассказывал тебе про байкал? therefore scored personal 0.9068 against world 0.9413. The public subject outweighed the question about what the owner had previously told Maven, and the boundary opened toward SearXNG.

Adding two plausible personal paraphrases did not move either score. Candidate similarities to the failing turn ranged from 0.8373 to 0.9022, still below the world proper-noun neighbour. This ruled out a missing synonym and argued against putting the held-out sentence or another Baikal-shaped exception into the seed set.

Change

Each class now scores as the mean of its three nearest seeds. The same k=3 applies on both sides, so the larger world class cannot win merely by having more coverage. Only the local neighbourhood is averaged because the personal class has two modes—possession and remembered speech—and a whole-class centroid would dilute them into each other.

This is a scoring change, not a seed or a phrase rule. The Baikal utterance remains held out.

Result

Gate one neighbour three neighbours
personal boundary 28/29 29/29
Baikal margin -0.0345 +0.0147
topic recognisers 43/43 43/43

The nearest personal true positive is когда мой следующий отпуск at +0.0110. The nearest world true negative is расскажи про эверест at -0.0135. No extra threshold is justified between them. The gate remains the sign of the class difference, favouring local refusal over sending owner-related text outward.