claude 9e2abea16b router/semantic: eval metrics for frozen evaluation set (slice 12) ...

EvalReport with macro F1, per-route precision/recall/F1, confusion
matrix, false-action rate, and fast-path vs residual breakdown.
ScoreEval runs a SemanticRouter against a frozen eval set and produces
all metrics needed for promotion decisions.

2026-09-07 01:42:36 +04:00

..

audio

audio and tts sweep: walk WAV chunks, name the stub sample rate (V-581)

2026-08-06 03:28:45 +04:00

auth

Give reminder cancellation its own store and IPC path (V-719)

2026-08-15 17:19:13 +04:00

calendar

calendar: read a wall clock as a wall clock, and unfold iCal (V-581)

2026-08-06 03:23:26 +04:00

capture

capture and dialogue: name two TTLs, fix a drifted comment (V-581)

2026-08-06 03:12:18 +04:00

claim

sweep claim, decision, netscan and vision (V-581)

2026-08-06 03:28:23 +04:00

config

Make locative recall prove identity, not overlap (V-719)

2026-08-15 17:19:01 +04:00

crawl

webfetch checks the status before it reads the body (V-581)

2026-08-06 03:12:59 +04:00

decision

router: introduce typed ingress boundary and route producer observability

2026-09-05 20:16:40 +04:00

delivery

Make delivery and integration failures explicit

2026-08-13 02:50:59 +04:00

dialogue

router: add ActionResolutionMethod type and ResolvedBy field to Slots

2026-09-06 13:49:50 +04:00

email

email: bound the MIME walk and drop two copies of every body (V-581)

2026-08-06 03:23:36 +04:00

event

docs: retire the two root queues, archive the ranking (V-447)

2026-08-02 09:11:11 +04:00

ipc

Give reminder cancellation its own store and IPC path (V-719)

2026-08-15 17:19:13 +04:00

kiwix

Try the capitalized title too, and reach Париж (V-668)

2026-08-09 10:52:24 +04:00

lexicon

Add the closed classes the new stage 0 frames need (V-720)

2026-08-15 17:18:37 +04:00

llm

Bound LLM completion responses (V-608)

2026-08-13 01:58:28 +04:00

loop

Give a suppressed rule a durable semantic identity (V-687)

2026-08-13 11:35:10 +04:00

mcp

gofmt mcp_test.go too (V-623)

2026-08-06 11:47:54 +04:00

media

media store: a failed write gives its budget reservation back (V-584)

2026-08-06 11:38:12 +04:00

memeval

memeval: scope the evaluator's note windows by source

2026-08-01 13:57:26 +04:00

memory

Make locative recall prove identity, not overlap (V-719)

2026-08-15 17:19:01 +04:00

modes

review: act.tool.hoststats was not a mode, and a nested id is the tell (V-631)

2026-08-06 18:51:23 +04:00

morning

Merge the rest-of-day cap (#262)

2026-08-06 05:12:20 +04:00

morph

morph: a dictionary answers the grammar questions (V-526)

2026-08-04 18:45:52 +04:00

netaddr

Unblock TCP Accept on listener close (V-679)

2026-08-13 02:03:32 +04:00

netscan

sweep claim, decision, netscan and vision (V-581)

2026-08-06 03:28:23 +04:00

pattern

pattern: a burst of taps is not a routine (V-468)

2026-08-04 03:00:11 +04:00

persona

say, persona, ttsnorm: the clock is spoken and the months have one copy (V-581)

2026-08-06 03:20:10 +04:00

phraser

Cancel a reminder by voice, and honour a refusal (V-719)

2026-08-15 17:19:25 +04:00

router

router/semantic: eval metrics for frozen evaluation set (slice 12)

2026-09-07 01:42:36 +04:00

routine

morning, routine: reject the two configs that silently do nothing (V-581)

2026-08-06 03:12:36 +04:00

rss

Bound the undated-item set per feed (V-641)

2026-08-07 01:32:15 +04:00

say

"что дальше?" answers with the next three, not the whole day (V-618)

2026-08-06 05:08:48 +04:00

smarthome

a tool row with no cmd no longer execs the utterance (V-581)

2026-08-06 03:11:53 +04:00

speaker

audio and tts sweep: walk WAV chunks, name the stub sample rate (V-581)

2026-08-06 03:28:45 +04:00

store

router: introduce typed ingress boundary and route producer observability

2026-09-05 20:16:40 +04:00

stt

Fall back on invalid remote transcripts (V-675)

2026-08-13 01:59:56 +04:00

tasks

tasks: count overdue by calendar day like the ranker does (V-581)

2026-08-06 03:12:28 +04:00

tool

gofmt the act target guard (V-634)

2026-08-06 20:55:53 +04:00

tts

audio and tts sweep: walk WAV chunks, name the stub sample rate (V-581)

2026-08-06 03:28:45 +04:00

ttsnorm

say, persona, ttsnorm: the clock is spoken and the months have one copy (V-581)

2026-08-06 03:20:10 +04:00

update

update: roll back what the restart actually deploys

2026-08-01 14:06:00 +04:00

vision

vision: hold the second request to the rule the first one follows

2026-08-01 14:21:46 +04:00

voice

One reader goroutine per voice conn, so a client can send and listen (V-671)

2026-08-09 13:44:52 +04:00

weather

Reject incomplete Open-Meteo responses (V-676)

2026-08-13 02:01:40 +04:00

webauthn

webauthn: lock the challenge maps and take a challenge once (V-581)

2026-08-06 03:24:00 +04:00

webfetch

Drop host rate-limit entries that can no longer delay anything (V-641)

2026-08-07 01:32:26 +04:00

websearch

the ZIM fallback fires fast, and reads Russian in Russian (V-508)

2026-08-05 15:52:54 +04:00

worker

A hung workstation no longer costs the resident model its budget (V-581)

2026-08-06 03:31:19 +04:00

zenmoney

a tool row with no cmd no longer execs the utterance (V-581)

2026-08-06 03:11:53 +04:00