Route with the resident model by default
The two things that made this unsafe are fixed: the router can now refuse, and slot extraction runs on its decisions. On the held-out fixture it gets 63.2% of intents right against the classifier's 50.0%, with no route errors. It costs about a second a turn instead of 30ms. The flag is a pointer now, so leaving it out of the config means on and only writing false turns it off. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01CGeSZxh1DCtRxmFVSYVGvJ
This commit is contained in:
+1
-1
@@ -40,7 +40,7 @@
|
||||
"tokenizer_path": "/opt/maven/models/embedder/multilingual-e5-small/tokenizer.json",
|
||||
"lib_path": "/opt/maven/lib/libonnxruntime.so"
|
||||
},
|
||||
"llm_router": false,
|
||||
"llm_router": true,
|
||||
"tool_timeout": "30s",
|
||||
"tools": [
|
||||
{ "name": "status", "cmd": ["systemctl", "status"], "scope": "homelab", "destructive": false },
|
||||
|
||||
Reference in New Issue
Block a user