kami/Maven
1
0
Fork 0
Code Issues 1 Pull Requests 1 Actions Packages Projects Releases Wiki Activity

Run the big model on the workstation, with admission control and the 1.7B as the floor #96

Merged
kami merged 3 commits from task/489-workstation-deploy-mavgpud-on-workpc-and into master 2026-08-03 10:12:14 +02:00
Conversation 0 Commits 3 Files Changed 5
+81 -2

3 Commits

Author SHA1 Message Date
claude eca41798bd mavgpud: turn gemma's thinking off in the chat template (V-489) 
Owner's call, 02-08-2026. Without it the 12B spends the reply budget on
reasoning tokens and answers empty at low max_tokens. Verified on the box:
"Столица Франции?" now answers "Париж" with no reasoning_content.
 2026-08-02 22:44:10 +04:00
claude cc423567e7 docs: record that contention is KFD presence, not a VRAM threshold (V-489) 2026-08-02 22:29:58 +04:00
claude 8088ef9e00 mavgpud: build it with the rest, and ship the workstation config and unit (V-489) 
make build now catches a broken supervisor on homesrv. deploy/mavgpud.json
carries the owner's gemma-4-12b line with the MTP draft model, passed to
llama-server untouched. The unit is a systemd user unit because sudo on the
workstation wants a password; lingering is the one command left to the owner.
 2026-08-02 22:29:57 +04:00