diff --git a/deploy/mavend.json b/deploy/mavend.json index 501e2dc..246b69f 100644 --- a/deploy/mavend.json +++ b/deploy/mavend.json @@ -39,6 +39,23 @@ "proxy": "socks5://192.168.240.1:10808" }, + "//workstation": [ + "The big model on the desk PC (bugmachine, 7900 GRE 16GB), fronted by", + "mavgpud on port 8080. It runs gemma-4-12b and it is preferred over the", + "resident Qwen3-1.7B for routing and replies whenever the card is free.", + "The machine is never assumed up: it sleeps, and the card is often held by", + "a CPT run, in which case mavgpud answers 503 and Maven falls back to the", + "resident model without saying so. Deleting this block restores exactly", + "the behaviour homesrv had before it existed.", + "Addressed by LAN address, not container name: mavgpud runs on another", + "machine and there is no shared docker network to name it on." + ], + "workstation": { + "url": "http://192.168.1.105:8080", + "probe": "15s", + "timeout": "90s" + }, + "//search": [ "The live web, searched after his own notes and before Kiwix. Only the", "query string leaves the box — never a note, a fact, the persona block or", diff --git a/docs/offload.md b/docs/offload.md index 4c6a6c8..32291fe 100644 --- a/docs/offload.md +++ b/docs/offload.md @@ -125,7 +125,12 @@ Then the embedder above, **whisper.cpp** in `mavsttd`, and **piper** in `mavttsd `internal/netaddr` landed in PR #92. A seam address now carries its own scheme, and a scheme-less one is still unix. A tcp seam requires a shared token, because the filesystem permission that authenticated the unix socket is gone. -2. **The resident model** (#485). Biggest quality delta. A 16GB card runs a 7-14B, +2. **The resident model** (#485). Half wired, 02-08-2026. A `workstation` block + builds an `llm.Pair` in `modelSeam` (`cmd/mavend/voicewire.go`), and routing + and replies complete through it. Both are the silent half of the rule. The + naming half is not wired. A world question still goes to the resident model + through `PhraseQuery`, and the fixture measurement has not been run. + Biggest quality delta. A 16GB card runs a 7-14B, which fixes what the 1.7B gets wrong: world knowledge, and the persona the CPT targets. The degradation path is already written and measured, since the classifier scores 68.8% full accuracy at p50 16.6µs on its own.