claude f9b2391a8b phraser: cap llama-server's prompt cache at 512 MiB (V-499) ...

The forwarded log named the cause in one line: the prompt cache limit
defaults to 8192 MiB. llama-server saves the full KV state of every idle
slot it evicts, 112 kiB per token, so RSS climbed about 170MB per
distinct prompt until the deployed server held 7.9GB for a 1.1GB model.

Measured on homesrv today, uncapped versus `--cache-ram 512`: RSS
plateaus at 932MB from the fourth distinct prompt instead of climbing.
The task's leading guess was wrong. `-ngl 99` costs almost no RSS,
because RADV keeps device memory outside the process. Numbers and method
in docs/evals/2026-08-03-llama-prompt-cache.md.

`-c 4096` is untouched. The knob is `phraser.cache_ram_mib`, unset means
512, negative passes no flag for a llama-server too old to know it.

The deploy still runs the old image, so the box keeps its 8 GiB default
until mavend is rebuilt.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

2026-08-03 23:20:25 +04:00

..

seedtest

fix zombie leak, add quiet-hours toggle, improve query reply, configurable router threshold, JS dashboard

2026-07-03 00:42:35 +02:00

testdata

simulator: make the negative assertions mean something, and give the ecosystem a scenario

2026-08-01 14:22:14 +04:00

ack_test.go

mavend: let a fact close the nudge that asked for it

2026-08-01 21:43:28 +04:00

ack.go

mavend: let a fact close the nudge that asked for it

2026-08-01 21:43:28 +04:00

actions_act.go

tool: separate a tool that is off from a backend that is down

2026-08-01 14:11:57 +04:00

actions_fact.go

store, mavend: a fact is indexed as the fact, not as the utterance (V-493)

2026-08-03 22:36:34 +04:00

actions_money_test.go

zenmoney: bound the day fact to its own day and stamp when it was read

2026-08-01 14:16:56 +04:00

actions_money.go

zenmoney: bound the day fact to its own day and stamp when it was read

2026-08-01 14:16:56 +04:00

actions_note.go

Capture tasks, with one intake seam mail can call later (#130)

2026-08-01 02:33:47 +04:00

actions_query_continued_test.go

query: only a source that knows the day may answer "а завтра?"

2026-08-01 22:32:37 +04:00

actions_query_personal_test.go

memory: score the personal boundary on seeds, not word lists (V-495)

2026-08-03 22:57:11 +04:00

actions_query_search_test.go

query: let her search the live web before she reads the ZIMs

2026-08-02 02:24:36 +04:00

actions_query.go

memory: score the personal boundary on seeds, not word lists (V-495)

2026-08-03 22:57:11 +04:00

actions_reminder.go

Split actions.go into per-intent files

2026-08-01 00:53:37 +04:00

actions_task_test.go

tasks: key derived captures by external id and record who resolved

2026-08-01 14:16:39 +04:00

actions_task.go

tasks: key derived captures by external id and record who resolved

2026-08-01 14:16:39 +04:00

actions.go

Merge branch 'refactor/query-sources' into integration/small-batch

2026-08-01 00:54:11 +04:00

capture_test.go

grammar: the last two model calls that were still free text

2026-08-02 02:28:53 +04:00

capture.go

grammar: the last two model calls that were still free text

2026-08-02 02:28:53 +04:00

clarify_test.go

mavend: run the persona checks over the clarify prose, document the proposal cooldown

2026-08-01 14:05:59 +04:00

clarify.go

dialogue: keep the remembered topic on the latest turn

2026-08-01 22:57:08 +04:00

coldstart_test.go

Derive the cold-start unlock key from the passkey PRF, not the public key (#14)

2026-08-01 05:49:27 +04:00

confirm.go

Voice parks a routine proposal, it never accepts it (V-367)

2026-08-02 09:58:07 +04:00

continuation_test.go

dialogue: keep the remembered topic on the latest turn

2026-08-01 22:57:08 +04:00

continuation.go

continuation: only an ellipsis may widen the keyword match

2026-08-01 22:21:28 +04:00

crawls_test.go

crawl: stop letting a watch widen on-demand reading, and honour Crawl-delay

2026-08-01 14:33:26 +04:00

crawls.go

crawl: stop letting a watch widen on-demand reading, and honour Crawl-delay

2026-08-01 14:33:26 +04:00

dayplan_test.go

mavend: give the voice handler a CoreAPI that can serve the day plan

2026-08-01 23:17:10 +04:00

digest_test.go

Add digest as a real outcome: suppressed care nudges get resurfaced, not lost

2026-07-31 23:09:22 +04:00

ecosystem_acts.go

ecosystem: assign one correlation ID per action and fail closed on scope

2026-08-01 14:15:33 +04:00

ecosystem_auth_test.go

hexis: re-vendor the client so a configured token is actually sent

2026-08-01 16:29:56 +04:00

ecosystem_degraded_test.go

test: make the ecosystem fault suite fail when the feature is deleted

2026-08-01 14:15:33 +04:00

ecosystem_harness_test.go

test: make the ecosystem fault suite fail when the feature is deleted

2026-08-01 14:15:33 +04:00

ecosystem_test.go

test: make the ecosystem fault suite fail when the feature is deleted

2026-08-01 14:15:33 +04:00

ecosystem_trace_test.go

store: give ecosystem traces their own table

2026-08-01 14:13:58 +04:00

ecosystem.go

hexis: re-vendor the client so a configured token is actually sent

2026-08-01 16:29:56 +04:00

entityrefs_test.go

test: make the ecosystem fault suite fail when the feature is deleted

2026-08-01 14:15:33 +04:00

eval_scenarios_test.go

Add daemon-side safety scenario tests driven by a JSON fixture

2026-07-30 23:49:22 +04:00

fact_subject_test.go

Wire voice-tapped facts into entity resolution; fix phraser model config

2026-07-20 12:13:30 +04:00

factenrichment_test.go

Add entity-aware fact resolution against Nexus (Vikunja #279)

2026-07-20 12:00:37 +04:00

factenrichment.go

enrichment: scan past backed-off facts instead of stalling behind them

2026-08-01 14:15:33 +04:00

factgate_test.go

store, mavend: a fact is indexed as the fact, not as the utterance (V-493)

2026-08-03 22:36:34 +04:00

factgate.go

mavend: a question is never a fact about him (V-470)

2026-08-03 13:40:33 +04:00

fakeecosystem_test.go

test: make the ecosystem fault suite fail when the feature is deleted

2026-08-01 14:15:33 +04:00

feeds_test.go

store: keep what she read out of what he said

2026-08-01 14:24:40 +04:00

feeds.go

Add meeting capture with explicit start and stop (#253)

2026-08-01 05:08:08 +04:00

followup_test.go

3.2 conversation depth: cross-intent anaphora + fact-by-key query

2026-07-06 13:40:16 +04:00

followup.go

fix: the slots converter was still dropping the fact Value (V-365)

2026-08-02 09:35:47 +04:00

intake_test.go

event: order the journal by notice time, and keep it to what arrived

2026-08-01 14:10:36 +04:00

intake.go

event: order the journal by notice time, and keep it to what arrived

2026-08-01 14:10:36 +04:00

keyfile_test.go

coldstart: recover v1 boxes, and make key wrapping an explicit act

2026-08-01 14:05:13 +04:00

keyfile.go

coldstart: recover v1 boxes, and make key wrapping an explicit act

2026-08-01 14:05:13 +04:00

kiwixwire_test.go

kiwix: read the article, not the snippet, and state the persona as morphology

2026-08-01 19:46:39 +04:00

kiwixwire.go

kiwix: read the article, not the snippet, and state the persona as morphology

2026-08-01 19:46:39 +04:00

llmrouter_flag_test.go

Add a voice.llm_router flag, default off

2026-07-31 02:15:30 +04:00

mail_test.go

llm: give voice turns priority on the single llama-server slot

2026-08-01 14:05:07 +04:00

mail.go

Merge branch 'fix/g06' into fix/integrated

2026-08-01 14:20:04 +04:00

main.go

phraser: cap llama-server's prompt cache at 512 MiB (V-499)

2026-08-03 23:20:25 +04:00

mcp_test.go

mcp: pin what a tool was when it was approved

2026-08-01 14:11:57 +04:00

mcp.go

mcp: pin what a tool was when it was approved

2026-08-01 14:11:57 +04:00

memoryeval.go

memeval: five minutes again, now that the gate keeps a turn from waiting

2026-08-02 02:16:45 +04:00

modelseam_test.go

mavend: route and reply through the workstation when its card is free (V-485)

2026-08-03 10:12:21 +02:00

modelswap.go

Merge branch 'fix/g07' into fix/integrated

2026-08-01 14:36:48 +04:00

netscan_test.go

netscan: stop the scan wedging, and stop it overstating the LAN

2026-08-01 14:01:01 +04:00

netscan.go

netscan: stop the scan wedging, and stop it overstating the LAN

2026-08-01 14:01:01 +04:00

patterns_test.go

Voice parks a routine proposal, it never accepts it (V-367)

2026-08-02 09:58:07 +04:00

patterns.go

Move the quiet-toggle and pattern-extraction slices out of voice.go (#321)

2026-08-01 01:30:06 +04:00

personalboundary_test.go

memory: score the personal boundary on seeds, not word lists (V-495)

2026-08-03 22:57:11 +04:00

personalboundary.go

memory: score the personal boundary on seeds, not word lists (V-495)

2026-08-03 22:57:11 +04:00

query_recall_test.go

Let a note win a recall, not only a fact (#373)

2026-07-31 13:30:38 +04:00

quiet_toggle_test.go

quiet: the noun form and the comparative are commands too

2026-08-01 21:35:58 +04:00

quiet_toggle.go

quiet: the noun form and the comparative are commands too

2026-08-01 21:35:58 +04:00

reactive_notes_test.go

feat: reactive notes test and router LFM foundation plan

2026-07-10 15:50:01 +04:00

recall_test.go

Let a note win a recall, not only a fact (#373)

2026-07-31 13:30:38 +04:00

recall.go

Let a note win a recall, not only a fact (#373)

2026-07-31 13:30:38 +04:00

replier_llm_test.go

grammar: the last two model calls that were still free text

2026-08-02 02:28:53 +04:00

replier_llm.go

grammar: the last two model calls that were still free text

2026-08-02 02:28:53 +04:00

ruwords.go

Extract the pure RU/string/weather helpers out of voice.go

2026-07-31 23:27:08 +04:00

searchwire.go

query: let her search the live web before she reads the ZIMs

2026-08-02 02:24:36 +04:00

simulator_test.go

docs: retire the two root queues, archive the ranking (V-447)

2026-08-02 09:11:11 +04:00

slotsparity_test.go

fix: the slots converter was still dropping the fact Value (V-365)

2026-08-02 09:35:47 +04:00

smarthome_test.go

smarthome: keep the devices under the cap, and stop asserting what the house did not do

2026-08-01 14:06:38 +04:00

smarthome.go

smarthome: keep the devices under the cap, and stop asserting what the house did not do

2026-08-01 14:06:38 +04:00

snooze_test.go

mavend: let him say "потом" to a nudge

2026-08-01 21:40:06 +04:00

snooze.go

mavend: let him say "потом" to a nudge

2026-08-01 21:40:06 +04:00

speaker_wiring_test.go

speaker: do not ship three methods that cannot work

2026-08-01 14:12:43 +04:00

speaker.go

speaker: do not ship three methods that cannot work

2026-08-01 14:12:43 +04:00

strutil.go

Extract the pure RU/string/weather helpers out of voice.go

2026-07-31 23:27:08 +04:00

system_reply_test.go

Drop the city time-zone table

2026-07-31 14:14:18 +04:00

tick_test.go

tick: a disabled rule must not keep repeating its last alarm

2026-08-01 20:43:27 +04:00

tick.go

mavend: give the voice handler a CoreAPI that can serve the day plan

2026-08-01 23:17:10 +04:00

vision_test.go

vision: scope the note, settle the contract, wait for the prune

2026-08-01 14:21:46 +04:00

vision.go

vision: scope the note, settle the contract, wait for the prune

2026-08-01 14:21:46 +04:00

voice.go

memory: score the personal boundary on seeds, not word lists (V-495)

2026-08-03 22:57:11 +04:00

voicewire.go

mavend: run the fact vector repair on start, and test what it does (V-493)

2026-08-03 22:36:54 +04:00

weatherq.go

Address PR review comments on 50, 52, 53, 54, 59, 61

2026-08-01 12:50:47 +04:00

worldmodel_test.go

mavend: world questions ask the workstation, and name the gap when it is asleep (V-490)

2026-08-03 12:27:40 +04:00

worldmodel.go

mavend: world questions ask the workstation, and name the gap when it is asleep (V-490)

2026-08-03 12:27:40 +04:00