kami
0cc6302245
Implements every P0 from AUDIT.md plus four P1s, across both halves of the pipeline. Verified by CPU-only self-checks and the orchestrator test suite. No GPU work ran and no pipeline ran. workpc: - worker_scene: read speaker_ref, not the rewritten speaker field. Every line narrated as "Someone" before this. Emit `actions` for the verifier. - worker_script: declare beat + verifier_feedback (pydantic dropped both, so the retry was blind) and render them as a repair prompt. - worker_vision: gate face->identity pairing on containment, assign globally shortest-first, map an out-of-range resolver index to `unresolved` instead of minting a character, parse JSON with raw_decode. - session_manager: tear down a server whose lease vanished mid-load, and spawn the supervisor respawn unlocked. orchestrator (edited in place, NOT committed there): - tracklets: canonicalize gender, add co-presence cannot-links, block transitive bridges across a hard constraint. - correctness: stop failing valid narration on sentence-initial capitals and short quotes; read action evidence from the singular key. - db: stop orphan flags leaking into every chapter; resolve by flag id. - service: TTS returns instead of raising under GATES, auto-resolves under autonomous mode; job admission control; registry names on dialogue resume. - session_proxy: queue on 409 instead of stealing the lease; run heartbeats. Docs restructured per the repo-structure layout: CLAUDE.md is a pointer table, NEXT.md replaces HANDOFF.md, plus ROADMAP.md, JOURNAL.md, decisions/ and caveats/. AUDIT.md now points at those instead of restating them. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01XD7cAy81MZrc7gCr6aZGWr
73 lines
3.8 KiB
Markdown
73 lines
3.8 KiB
Markdown
# CLAUDE.md
|
|
|
|
Goal, invariants, and working rules. Read this first.
|
|
|
|
| file | holds |
|
|
| --- | --- |
|
|
| `NEXT.md` | the current state and the live plan |
|
|
| `ROADMAP.md` | the ordered outcomes past the current one |
|
|
| `JOURNAL.md` | what was run and when, append-only |
|
|
| `decisions/` | every settled question, indexed in `decisions/CLAUDE.md` |
|
|
| `caveats/` | every known limit and its revisit trigger, indexed in `caveats/CLAUDE.md` |
|
|
| `AGENTS.md` | commands, with the traps beside them |
|
|
| `AUDIT.md` | the 2026-08-11 pipeline audit, the source of the roadmap |
|
|
| `spec-v3.md` | current quality and look work, marked DONE/TODO per item |
|
|
|
|
Do not restate a finding here. Point at the decision.
|
|
|
|
## The goal
|
|
|
|
This is the **workpc compute half** of a manga to narrated-video pipeline. It holds stateless GPU and
|
|
CPU workers only. State, job scheduling, and stage orchestration live in a separate homesrv
|
|
orchestrator repo (`/mnt/server/home/kami/docker-apps/manga-infra/orchestrator/`). The two talk over a
|
|
fixed HTTP contract. The hard part is that one GPU serves every model, so the schedule, not the model,
|
|
sets the wall time.
|
|
|
|
Machine split: workers run on **workpc** (RX 7900 GRE, ROCm). MinIO and the orchestrator run on
|
|
**homesrv** (`192.168.1.104`, CPU-only). `/mnt/server/home/kami/` is an SSHFS mount of homesrv.
|
|
|
|
## Invariants
|
|
|
|
1. **No durable state in a worker.** No sqlite, no cross-request memory. A worker pulls inputs from
|
|
MinIO by URI, does one stage, pushes outputs back, returns URIs. A `/dev/shm` cache is allowed
|
|
because it may be dropped at any time.
|
|
2. **One warm model at a time.** Every GPU stage takes a lease from `session_manager.py` on 8095. A 409
|
|
is a queue signal, never a stale lease
|
|
(`decisions/audit-phase1.md#no-lease-stealing`).
|
|
3. **Never hold `_lock` across a model load or a health wait** in `session_manager.py`
|
|
(`decisions/audit-phase1.md#unlocked-model-load`).
|
|
4. **A dialogue row's speaker is `speaker_ref`.** The flat `speaker` field is a compatibility value and
|
|
holds a `character_id`, not a panel-local id
|
|
(`decisions/audit-phase1.md#speaker-ref-is-canonical`).
|
|
5. **A stage never raises after setting `awaiting_review`.** The pipeline's catch-all overwrites it
|
|
with `failed` (`decisions/audit-phase1.md#flag-resolution`).
|
|
6. **Never mint a character from an unparseable or out-of-range model answer.** That is `unresolved`
|
|
(`decisions/audit-phase1.md#hallucinated-index`).
|
|
7. **The HTTP contract with the orchestrator is load-bearing.** Changing a worker's request or response
|
|
shape means reconciling the orchestrator in the same session. Neither repo's self-checks can catch a
|
|
contract break, because each asserts its own side.
|
|
8. **`ponytail:` comments mark deliberate simplifications** and name the upgrade path. Respect them.
|
|
|
|
## Working rules
|
|
|
|
```bash
|
|
./start_workers.sh # dev: session_manager + 9 workers, each a uvicorn in a tmux window
|
|
tmux attach -t manga-workers # per-worker logs
|
|
sudo systemd/install.sh # production: one systemd unit per process (User=kami)
|
|
|
|
.venv/bin/python worker_scene.py # every module has an assert-based __main__ self-check
|
|
.venv/bin/python test_vision_parse.py
|
|
|
|
cd /mnt/server/home/kami/docker-apps/manga-infra/orchestrator && pytest -q --ignore=test_api.py
|
|
```
|
|
|
|
There is no lint or build step. `.venv` is the ROCm torch env. Workers import `transport` by module
|
|
name. Ports: crop 8000, vision 8002, identity 8003, scene 8004, script 8005, tts 8006, layers 8007,
|
|
render 8008, session_manager 8095.
|
|
|
|
- Any non-trivial logic gets ONE runnable check in `__main__`, assert-based, no framework. Run the file
|
|
to verify it.
|
|
- Editing a worker's request or response shape means editing the orchestrator too, in the same session.
|
|
- Update `NEXT.md` alongside any change that moves the plan, and append to `JOURNAL.md` after a run.
|
|
- Do not run GPU work or a full pipeline without asking.
|