mavgpud: turn gemma's thinking off in the chat template (V-489)

Owner's call, 02-08-2026. Without it the 12B spends the reply budget on reasoning tokens and answers empty at low max_tokens. Verified on the box: "Столица Франции?" now answers "Париж" with no reasoning_content.
2026-08-02 22:44:10 +04:00
parent cc423567e7
commit eca41798bd
1 changed files with 1 additions and 0 deletions
@@ -15,6 +15,7 @@
    "--batch-size", "2048",
    "--ubatch-size", "512",
    "--jinja",
+    "--chat-template-kwargs", "{\"enable_thinking\":false}",
    "--spec-type", "draft-mtp",
    "--spec-draft-n-max", "2"
  ],