manga-recap-pipeline/CLAUDE.md

CLAUDE.md

Goal, invariants, and working rules. Read this first.

file	holds
NEXT.md	the current state and the live plan
ROADMAP.md	the ordered outcomes past the current one
JOURNAL.md	what was run and when, append-only
decisions/	every settled question, indexed in decisions/CLAUDE.md
caveats/	every known limit and its revisit trigger, indexed in caveats/CLAUDE.md
AGENTS.md	commands, with the traps beside them
AUDIT.md	the 2026-08-11 pipeline audit, the source of the roadmap
spec-v3.md	current quality and look work, marked DONE/TODO per item

Do not restate a finding here. Point at the decision.

The goal

This is the workpc compute half of a manga to narrated-video pipeline. It holds stateless GPU and CPU workers only. State, job scheduling, and stage orchestration live in a separate homesrv orchestrator repo (/mnt/server/home/kami/docker-apps/manga-infra/orchestrator/). The two talk over a fixed HTTP contract. The hard part is that one GPU serves every model, so the schedule, not the model, sets the wall time.

Machine split: workers run on workpc (RX 7900 GRE, ROCm). MinIO and the orchestrator run on homesrv (192.168.1.104, CPU-only). /mnt/server/home/kami/ is an SSHFS mount of homesrv.

Invariants

1. No durable state in a worker. No sqlite, no cross-request memory. A worker pulls inputs from MinIO by URI, does one stage, pushes outputs back, returns URIs. A /dev/shm cache is allowed because it may be dropped at any time.
2. One warm model at a time. Every GPU stage takes a lease from session_manager.py on 8095. A 409 is a queue signal, never a stale lease (decisions/audit-phase1.md#no-lease-stealing).
3. Never hold _lock across a model load or a health wait in session_manager.py (decisions/audit-phase1.md#unlocked-model-load).
4. A dialogue row's speaker is speaker_ref. The flat speaker field is a compatibility value and holds a character_id, not a panel-local id (decisions/audit-phase1.md#speaker-ref-is-canonical).
5. A stage never raises after setting awaiting_review. The pipeline's catch-all overwrites it with failed (decisions/audit-phase1.md#flag-resolution).
6. Never mint a character from an unparseable or out-of-range model answer. That is unresolved (decisions/audit-phase1.md#hallucinated-index).
7. The HTTP contract with the orchestrator is load-bearing. Changing a worker's request or response shape means reconciling the orchestrator in the same session. Neither repo's self-checks can catch a contract break, because each asserts its own side.
8. ponytail: comments mark deliberate simplifications and name the upgrade path. Respect them.

Working rules

./start_workers.sh              # dev: session_manager + 9 workers, each a uvicorn in a tmux window
tmux attach -t manga-workers    # per-worker logs
sudo systemd/install.sh         # production: one systemd unit per process (User=kami)

.venv/bin/python worker_scene.py    # every module has an assert-based __main__ self-check
.venv/bin/python test_vision_parse.py

cd /mnt/server/home/kami/docker-apps/manga-infra/orchestrator && pytest -q --ignore=test_api.py

There is no lint or build step. .venv is the ROCm torch env. Workers import transport by module name. Ports: crop 8000, vision 8002, identity 8003, scene 8004, script 8005, tts 8006, layers 8007, render 8008, session_manager 8095.

• Any non-trivial logic gets ONE runnable check in __main__, assert-based, no framework. Run the file to verify it.
• Editing a worker's request or response shape means editing the orchestrator too, in the same session.
• Update NEXT.md alongside any change that moves the plan, and append to JOURNAL.md after a run.
• Do not run GPU work or a full pipeline without asking.