kami/correx
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix(inference): narration model_id accepts bare provider id from TOML

Browse Source 
The router matched only the adapter-prefixed registry id
(llama-cpp:narrator) while the operator's [router.narration] model_id
naturally repeats the bare [[providers]] id (narrator), so the match
always failed and narration silently fell back to the slow main model.
Match either form.
This commit is contained in:
kami
2026-06-12 13:56:28 +04:00
parent e195c79510
commit df3ee0bbe0
1 changed files with 5 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
core/inference/src/main/kotlin/com/correx/core/inference/DefaultInferenceRouter.kt
+5 -1
View File
@@ -69,7 +69,11 @@ class DefaultInferenceRouter(
val all = registry.listAll() val all = registry.listAll()
val healthy = all.filter { cachedHealth(it) !is ProviderHealth.Unavailable } val healthy = all.filter { cachedHealth(it) !is ProviderHealth.Unavailable }
val matched = healthy.firstOrNull { it.id.value == modelId } // Registry ids are adapter-prefixed ("llama-cpp:narrator") while the operator's TOML
// declares the bare id ("narrator") — accept either form.
val matched = healthy.firstOrNull {
it.id.value == modelId || it.id.value.substringAfter(':') == modelId
}
if (matched == null) { if (matched == null) {
log.warn( log.warn(
"narration model_id '{}' matched no healthy provider — falling back to capability routing", "narration model_id '{}' matched no healthy provider — falling back to capability routing",