Compare commits
22 Commits
| Author | SHA1 | Date | |
|---|---|---|---|
| 9ac32c9e93 | |||
| b43ab77eee | |||
| 95b16a5047 | |||
| 0a001c42c7 | |||
| 68c56b6af6 | |||
| 1b58bc325e | |||
| 7b90944b61 | |||
| 6010f6b6c0 | |||
| 0e1095e9ba | |||
| e25e9e46fd | |||
| 9e62097c97 | |||
| 1dca8c7f25 | |||
| e5a5cddc96 | |||
| 3e31ebcc1e | |||
| 0a89fafd45 | |||
| 63e8b4f5d6 | |||
| 633da3d2df | |||
| 59a0ad3c2b | |||
| a2b97221d5 | |||
| 53d8108189 | |||
| ed7efb6072 | |||
| 3a48ecd24f |
@@ -8,6 +8,41 @@
|
||||
- AGENTS.md files are binding work contracts for their subtrees
|
||||
- Work products, source materials, instructions, records, assets, and durable docs must stay understandable from the nearest applicable AGENTS.md plus every parent AGENTS.md above it
|
||||
|
||||
## Project Architecture
|
||||
|
||||
- Correx is a local-first, event-sourced orchestration kernel for LLM workflows, built with Kotlin/JVM 21 and Gradle.
|
||||
- The event log is the sole source of truth. State is rebuilt from events; projections are disposable and owned by their bounded context.
|
||||
- Keep deterministic core logic separate from nondeterministic inputs: LLM and tool outputs are untrusted proposals until validation; policy denials are terminal and cannot be overridden.
|
||||
- Record each nondeterministic environment observation (for example filesystem, network, retrieval, or clock data) as an event when observed. Replay and downstream logic must use recorded facts and make no external calls.
|
||||
- Tools must declare an execution tier and record every side effect as events. Compression and other derived representations are non-authoritative and cannot replace original events.
|
||||
- New `EventPayload` implementations must be registered in `core/events/.../serialization/Serialization.kt` in the `eventModule` polymorphic block; otherwise runtime deserialization can fail silently.
|
||||
|
||||
## Module Boundaries
|
||||
|
||||
- `core/` contains domain logic and may not depend on `infrastructure/` or `apps/`.
|
||||
- `infrastructure/` implements adapters against core contracts; `apps/` composes core and infrastructure into runnable processes.
|
||||
- Do not introduce circular dependencies or dependencies from a module to a sibling core module unless the module architecture explicitly establishes one. Shared event vocabulary belongs in `core:events`.
|
||||
- Inject dependencies rather than constructing concrete collaborators inside domain classes; use existing interfaces at boundaries.
|
||||
|
||||
## Kotlin Work Guidance
|
||||
|
||||
- Keep reducers limited to deterministic state transitions; do not put domain decisions or side effects in reducers.
|
||||
- Convert exceptions to sealed domain results at the earliest practical boundary. Do not use broad `try`/`catch` that silently returns a fallback.
|
||||
- Use coroutine-safe patterns: put blocking I/O in `Dispatchers.IO`, never use `Thread.sleep()`, and do not swallow `CancellationException`.
|
||||
- Before finalizing a Kotlin file, remove unused imports and verify direct imports only.
|
||||
|
||||
## Verification and Context
|
||||
|
||||
- Tests for production modules may live under `testing/`; search there before deciding a module has no tests.
|
||||
- Run focused tests with `./gradlew :path:to:module:test --rerun-tasks`. Run `./gradlew check` for the full test, Detekt, and Kover verification suite.
|
||||
- Detekt failures are enforced. Prefer correcting violations; use the narrowest suppression only for a genuine false positive.
|
||||
- Use `python scripts/ctx.py <query>` for ranked code context and `python scripts/ctx.py --deps <file>` for symbol dependency context when relevant.
|
||||
|
||||
## Task Tracking
|
||||
|
||||
- Use the Vikunja **Correx** project (`project_id: 4`) as the cross-session, user-visible backlog for follow-up work the user wants retained, such as deferred fixes, unverified QA gates, and designed-but-unimplemented work.
|
||||
- Use the available Vikunja integration to review, create, and close tasks. Keep each task self-contained with its root cause, chosen fix, and relevant file paths so it can be resumed without prior session context.
|
||||
|
||||
## Read Before Editing
|
||||
|
||||
1. Read the root AGENTS.md
|
||||
|
||||
@@ -29,7 +29,7 @@ import kotlinx.serialization.json.jsonObject
|
||||
import kotlinx.serialization.json.jsonPrimitive
|
||||
|
||||
@Serializable
|
||||
private data class StartSessionRequest(val workflowId: String, val sessionId: String?)
|
||||
private data class StartSessionRequest(val workflowId: String, val sessionId: String?, val intent: String? = null)
|
||||
|
||||
@Serializable
|
||||
private data class StartSessionResponse(val sessionId: String)
|
||||
@@ -60,6 +60,7 @@ class RunCommand : CliktCommand(name = "run") {
|
||||
private val workflow by option("--workflow", help = "Path to workflow definition").required()
|
||||
private val sessionId by option("--session", help = "Existing session ID to resume")
|
||||
private val autoApprove by option("--auto-approve", help = "Auto-approve all approval requests").flag()
|
||||
private val intent by option("--intent", help = "Freestyle intent to seed a new session")
|
||||
private val host by option("--host", help = "Server host").default("localhost")
|
||||
private val port by option("--port", help = "Server port").default("$DEFAULT_PORT")
|
||||
|
||||
@@ -108,7 +109,7 @@ class RunCommand : CliktCommand(name = "run") {
|
||||
): String? = runCatching {
|
||||
val resp = client.post("http://$host:$portInt/sessions") {
|
||||
contentType(ContentType.Application.Json)
|
||||
setBody(StartSessionRequest(workflowId = resolveWorkflowId(workflow), sessionId = sessionId))
|
||||
setBody(StartSessionRequest(resolveWorkflowId(workflow), sessionId, intent))
|
||||
}
|
||||
resp.body<StartSessionResponse>().sessionId
|
||||
}.getOrElse { e ->
|
||||
|
||||
@@ -19,6 +19,9 @@ All sources under `apps/server/src/`.
|
||||
- `GET /health` — health report (probes: event-store, llama-server, disk watermark)
|
||||
- `GET /stats` — metrics report (MetricsProjection)
|
||||
- `GET /metrics/tool-reliability` — per-model tool-call validity across the event log (`ToolReliabilityInspectionService`); groundwork for capability-aware routing
|
||||
- Optional `[git]` transport creates `run/<sessionId>` from a server-local checkout and pushes it at terminal state; clients review with ordinary Git and never supply a remote URL as `cwd`.
|
||||
- Repo-map L3 embeddings use bounded, recorded source descriptors (module/package, imports, leading purpose comment, symbols); raw file bodies are never embedded. Their versioned `repomap:v2` namespace forces a one-time re-embed when the semantic document format changes.
|
||||
- At boot, `tools.workspace_root` is the authoritative tool jail and project-observation root. A configured `tools.working_dir` may only remain distinct when it is contained by that root; an outside value is clamped to `workspace_root`. Project memory and repo-map indexing are also rebound to `workspace_root`, so a stale `[project].root` cannot inject files from outside the session workspace.
|
||||
|
||||
### WebSocket protocol (`/ws`)
|
||||
- **ServerMessage** (server → client): sealed hierarchy — `SessionMessage` (event-derived, carries `sequence` + `sessionSequence`) and `NonEventMessage` (control/infra). Variants include session lifecycle, approval requests, clarification requests, narration, proposed workflows, health/metrics pushes.
|
||||
|
||||
@@ -0,0 +1,35 @@
|
||||
package com.correx.apps.server
|
||||
|
||||
import com.correx.core.config.ProjectConfig
|
||||
import java.nio.file.Path
|
||||
|
||||
internal data class BootWorkspace(
|
||||
val workspaceRoot: Path,
|
||||
val workingDir: Path,
|
||||
val workingDirWasClamped: Boolean,
|
||||
)
|
||||
|
||||
internal fun resolveBootWorkspace(
|
||||
explicitWorkspaceRoot: Path?,
|
||||
explicitWorkingDir: Path?,
|
||||
processWorkingDir: Path,
|
||||
): BootWorkspace {
|
||||
val workspaceRoot = (explicitWorkspaceRoot ?: explicitWorkingDir ?: processWorkingDir)
|
||||
.toAbsolutePath()
|
||||
.normalize()
|
||||
val requestedWorkingDir = (explicitWorkingDir ?: workspaceRoot)
|
||||
.toAbsolutePath()
|
||||
.normalize()
|
||||
val workingDirIsContained = requestedWorkingDir.startsWith(workspaceRoot)
|
||||
|
||||
return BootWorkspace(
|
||||
workspaceRoot = workspaceRoot,
|
||||
workingDir = requestedWorkingDir.takeIf { workingDirIsContained } ?: workspaceRoot,
|
||||
workingDirWasClamped = !workingDirIsContained,
|
||||
)
|
||||
}
|
||||
|
||||
/** Keep repo-map observation and L3 project memory inside the authoritative boot workspace. */
|
||||
internal fun ProjectConfig.boundToWorkspace(workspaceRoot: Path): ProjectConfig = copy(
|
||||
root = workspaceRoot.toAbsolutePath().normalize().toString(),
|
||||
)
|
||||
@@ -83,6 +83,7 @@ import com.correx.core.events.types.SessionId
|
||||
import com.correx.infrastructure.InfrastructureModule
|
||||
import com.correx.infrastructure.inference.DefaultProviderRegistry
|
||||
import com.correx.infrastructure.workflow.ExecutionPlanCompiler
|
||||
import com.correx.infrastructure.workflow.Lsp4jDiagnosticsRunner
|
||||
import com.correx.infrastructure.workflow.PlanLinter
|
||||
import com.correx.infrastructure.inference.CapabilityAwareRoutingStrategy
|
||||
import com.correx.infrastructure.inference.commons.ManagedInferenceRouter
|
||||
@@ -210,14 +211,21 @@ fun main() {
|
||||
val explicitWorkspaceRoot = System.getenv("CORREX_WORKSPACE_ROOT")
|
||||
?.let { Path.of(it) }
|
||||
?: toolsConfig.workspaceRoot.takeIf { it.isNotEmpty() }?.let { Path.of(it) }
|
||||
// workingDir and workspaceRoot must resolve to the same tree by default — the tool-call
|
||||
// assessor's containment rules (PathContainmentRule, ManifestContainmentRule) only ever see
|
||||
// workspaceRoot, while FileWriteTool resolves relative paths against workingDir. If only one
|
||||
// is configured, each falls back to the other before falling back to process CWD, so the
|
||||
// assessor's containment check and the actual write always share one resolved root.
|
||||
val shellAllowedExecutables = toolsConfig.shellAllowedExecutables.toSet()
|
||||
val workspaceRoot = explicitWorkspaceRoot ?: explicitWorkingDir ?: Path.of("").toAbsolutePath()
|
||||
val workingDir = explicitWorkingDir ?: workspaceRoot
|
||||
val bootWorkspace = resolveBootWorkspace(
|
||||
explicitWorkspaceRoot = explicitWorkspaceRoot,
|
||||
explicitWorkingDir = explicitWorkingDir,
|
||||
processWorkingDir = Path.of(""),
|
||||
)
|
||||
val workspaceRoot = bootWorkspace.workspaceRoot
|
||||
val workingDir = bootWorkspace.workingDir
|
||||
if (bootWorkspace.workingDirWasClamped) {
|
||||
log.warn(
|
||||
"configured working_dir {} is outside workspace_root {}; clamping working_dir to workspace_root",
|
||||
explicitWorkingDir,
|
||||
workspaceRoot,
|
||||
)
|
||||
}
|
||||
// One shared HTTP client backs both the default and per-workspace registries' research tools
|
||||
// (web_search/web_fetch). Built only when research is enabled, so the static path stays offline.
|
||||
// Lives for the process lifetime (shared across requests), so it's closed via shutdown hook
|
||||
@@ -262,7 +270,42 @@ fun main() {
|
||||
)
|
||||
// Retrieves full tool output the kernel spilled to CAS on truncation (ref shown in-context).
|
||||
val toolOutputTool = com.correx.infrastructure.tools.ToolOutputTool(artifactStore)
|
||||
val extraTools = taskTools + toolOutputTool
|
||||
// Mount configured MCP servers: each server's tools/list becomes Correx tools that ride the normal
|
||||
// ToolExecutor path (tier-gated, event-recorded, replay-safe — no special-casing). A server that
|
||||
// fails to start is logged and skipped rather than aborting the whole process.
|
||||
val mountedMcpServers = correxConfig.mcp.mapNotNull { mcpConfig ->
|
||||
runCatching {
|
||||
runBlocking {
|
||||
com.correx.infrastructure.tools.mcp.McpMounter.mount(
|
||||
serverId = mcpConfig.id,
|
||||
command = mcpConfig.command,
|
||||
env = mcpConfig.env,
|
||||
tier = runCatching { com.correx.core.approvals.Tier.valueOf(mcpConfig.tier) }
|
||||
.getOrDefault(com.correx.core.approvals.Tier.T2),
|
||||
)
|
||||
}
|
||||
}.onSuccess { log.info("Mounted MCP server '{}' ({} tools)", mcpConfig.id, it.tools.size) }
|
||||
.onFailure { log.warn("Failed to mount MCP server '{}': {}", mcpConfig.id, it.message) }
|
||||
.getOrNull()
|
||||
}
|
||||
if (mountedMcpServers.isNotEmpty()) {
|
||||
Runtime.getRuntime().addShutdownHook(Thread {
|
||||
mountedMcpServers.forEach { server ->
|
||||
runCatching { server.close() }
|
||||
.onFailure { log.warn("Error closing MCP server '{}': {}", server.serverId, it.message) }
|
||||
}
|
||||
})
|
||||
}
|
||||
val mcpTools = mountedMcpServers.flatMap { it.tools }
|
||||
// Index the workspace into codebase-memory (#242) off the startup path — a fast index makes its
|
||||
// search tools usable by the first session instead of failing "not indexed"; a slow index just
|
||||
// means the first stage or two miss it, not a blocked boot.
|
||||
if (mcpTools.any { it.name.endsWith("__index_repository") }) {
|
||||
Thread {
|
||||
runBlocking { bootstrapCodebaseIndex(mcpTools, workspaceRoot, log) }
|
||||
}.apply { isDaemon = true; name = "mcp-index-bootstrap" }.start()
|
||||
}
|
||||
val extraTools = taskTools + toolOutputTool + mcpTools
|
||||
val toolRegistry = InfrastructureModule.createToolRegistry(
|
||||
buildToolConfig(
|
||||
workspaceRoot,
|
||||
@@ -342,6 +385,7 @@ fun main() {
|
||||
workspacePolicy = workspacePolicy,
|
||||
workspaceToolRegistryProvider = wsToolRegistryProvider,
|
||||
staticAnalysisRunner = ProcessStaticAnalysisRunner(),
|
||||
lspDiagnosticsRunner = Lsp4jDiagnosticsRunner(),
|
||||
contractAssertionEvaluator = FileSystemContractEvaluator(),
|
||||
semanticReviewer = SemanticReviewerImpl(inferenceRouter),
|
||||
)
|
||||
@@ -422,6 +466,7 @@ fun main() {
|
||||
maxClarificationRounds = maxClarificationRounds,
|
||||
reviewBlockMinConfidence = reviewBlockMinConfidence,
|
||||
reviewBlockRetryCap = reviewBlockRetryCap,
|
||||
reviewLoopMaxCycles = reviewLoopMaxCycles,
|
||||
defaultMaxRefinement = defaultMaxRefinement,
|
||||
recoveryRouteBudget = recoveryRouteBudget,
|
||||
intentRouteBudget = intentRouteBudget,
|
||||
@@ -535,12 +580,17 @@ fun main() {
|
||||
} else {
|
||||
null
|
||||
}
|
||||
// Heuristic concept compiler (design 2026-07-12-acr-concept-compiler.md): promotes recurring
|
||||
// validated failure→fix patterns into L3 as retrieval-on-demand concepts. Fires only on ≥N
|
||||
// cross-session validated fixes, so it's harmless to run unconditionally.
|
||||
val conceptCompilerService =
|
||||
com.correx.apps.server.concept.ConceptCompilerService(eventStore, embedder, l3MemoryStore)
|
||||
// Built from a config snapshot and reused by ConfigService's rebuild hook so toggling
|
||||
// project.enabled / personalization.* applies live to the next session.
|
||||
fun buildProjectMemory(cfg: CorrexConfig): com.correx.apps.server.memory.ProjectMemoryService? =
|
||||
if (cfg.project.enabled) {
|
||||
com.correx.apps.server.memory.ProjectMemoryService(
|
||||
config = cfg.project,
|
||||
config = cfg.project.boundToWorkspace(workspaceRoot),
|
||||
embedder = embedder,
|
||||
l3MemoryStore = l3MemoryStore,
|
||||
journalRepository = decisionJournalRepository,
|
||||
@@ -574,6 +624,20 @@ fun main() {
|
||||
requestPlanApproval = { sid, planJson -> orchestrator.requestPlanApproval(sid, planJson) },
|
||||
toolCapabilities = toolRegistry.all().associate { it.name to it.requiredCapabilities },
|
||||
reflector = com.correx.apps.server.inference.CapabilityGapReflectorImpl(inferenceRouter),
|
||||
// Return-to-architect: re-run the planning workflow from the architect stage so it emits a
|
||||
// corrected plan after a grounding rejection. rehydrate before (architect needs the analyst's
|
||||
// dod, evicted on the planning graph's completion) and after (the fresh execution_plan is
|
||||
// evicted again when this re-run completes — lockAndRun's planContent must read it back).
|
||||
rerunArchitect = { sid ->
|
||||
orchestrator.rehydrate(sid)
|
||||
val planningGraph = workflowRegistry.find("freestyle_planning")
|
||||
?: error("freestyle_planning workflow not registered")
|
||||
val result = orchestrator.runFrom(
|
||||
sid, planningGraph, defaultOrchestrationConfig, com.correx.core.events.types.StageId("architect"),
|
||||
)
|
||||
orchestrator.rehydrate(sid)
|
||||
result
|
||||
},
|
||||
)
|
||||
// observability-spec §4: continuous health watch. Seed the monitor's last-status from the
|
||||
// recorded system-session events so a restart doesn't re-emit a degraded already in the log.
|
||||
@@ -638,6 +702,7 @@ fun main() {
|
||||
narrationMaxPerRun = correxConfig.talkie.narration.maxPerRun,
|
||||
projectMemory = projectMemory,
|
||||
architectContradictionChecker = architectContradictionChecker,
|
||||
conceptCompilerService = conceptCompilerService,
|
||||
configHolder = configHolder,
|
||||
freestyleDriver = freestyleDriver,
|
||||
operatorProfile = operatorProfile,
|
||||
@@ -648,6 +713,11 @@ fun main() {
|
||||
taskArtifactResolver = taskArtifactResolver,
|
||||
taskSessionResolver = taskSessionResolver,
|
||||
gitCommitReader = gitCommitReader,
|
||||
gitRunBranchTransport = if (correxConfig.git.enabled) {
|
||||
com.correx.apps.server.git.GitRunBranchTransport(eventStore, correxConfig.git)
|
||||
} else {
|
||||
null
|
||||
},
|
||||
)
|
||||
// Wire live config editing: persist to TOML, swap the holder, and rebuild config-derived
|
||||
// services. Built after the module so the rebuild hook can swap them in place.
|
||||
@@ -860,7 +930,7 @@ private fun buildToolConfig(
|
||||
toolsConfig: com.correx.core.config.ToolsConfig,
|
||||
research: com.correx.infrastructure.tools.ResearchToolConfig,
|
||||
): ToolConfig {
|
||||
val allowed = setOf(workspaceRoot, workingDir)
|
||||
val allowed = setOf(workspaceRoot)
|
||||
return ToolConfig(
|
||||
shell = ShellConfig(
|
||||
enabled = toolsConfig.shellEnabled,
|
||||
|
||||
@@ -0,0 +1,40 @@
|
||||
package com.correx.apps.server
|
||||
|
||||
import com.correx.core.events.events.ToolRequest
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.events.types.StageId
|
||||
import com.correx.core.events.types.ToolInvocationId
|
||||
import com.correx.core.tools.contract.Tool
|
||||
import com.correx.core.tools.contract.ToolExecutor
|
||||
import com.correx.core.tools.contract.ToolResult
|
||||
import org.slf4j.Logger
|
||||
import java.nio.file.Path
|
||||
import java.util.UUID
|
||||
|
||||
/**
|
||||
* Bootstraps the codebase-memory index for the boot workspace (#242): its search tools are dead on
|
||||
* arrival ("project not found or not indexed") until `index_repository` runs once against the repo,
|
||||
* and nothing in a workflow calls it. If a mounted MCP server advertises an `index_repository` tool
|
||||
* we invoke it here, at working-dir open, with the workspace root — through the normal ToolExecutor
|
||||
* path, so no special-casing.
|
||||
*
|
||||
* ponytail: single-workspace boot only, "fast" mode. When per-connection working dirs land, hang
|
||||
* this off the WS-open hook as one entry in a bootstrap registry; one action doesn't earn a registry
|
||||
* yet. "fast" skips similarity/semantic edges — quickest to ready; upgrade the mode if search recall
|
||||
* proves thin.
|
||||
*/
|
||||
internal suspend fun bootstrapCodebaseIndex(mcpTools: List<Tool>, workspaceRoot: Path, log: Logger) {
|
||||
val tool = mcpTools.firstOrNull { it.name.endsWith("__index_repository") } ?: return
|
||||
val executor = tool as? ToolExecutor ?: return
|
||||
val request = ToolRequest(
|
||||
invocationId = ToolInvocationId(UUID.randomUUID().toString()),
|
||||
sessionId = SessionId("boot"),
|
||||
stageId = StageId("boot"),
|
||||
toolName = tool.name,
|
||||
parameters = mapOf("repo_path" to workspaceRoot.toString(), "mode" to "fast"),
|
||||
)
|
||||
when (val result = executor.execute(request)) {
|
||||
is ToolResult.Success -> log.info("Indexed workspace into codebase-memory ({})", tool.name)
|
||||
is ToolResult.Failure -> log.warn("codebase-memory index bootstrap failed: {}", result.reason)
|
||||
}
|
||||
}
|
||||
@@ -20,6 +20,7 @@ import com.correx.core.config.ProjectProfileLoader
|
||||
import com.correx.apps.server.memory.ArchitectContradictionChecker
|
||||
import com.correx.core.events.events.AgentInstructionsBoundEvent
|
||||
import com.correx.core.events.events.ApprovalRequestedEvent
|
||||
import com.correx.core.events.events.StageCompletedEvent
|
||||
import com.correx.core.events.events.ArtifactContentStoredEvent
|
||||
import com.correx.core.events.events.ArtifactCreatedEvent
|
||||
import com.correx.core.events.events.EventMetadata
|
||||
@@ -103,6 +104,9 @@ class ServerModule(
|
||||
// (tests / project.enabled=false). Unlike projectMemory there is no live config-rebuild hook:
|
||||
// a server restart re-reads project.enabled, which is enough for this informational flag.
|
||||
private val architectContradictionChecker: ArchitectContradictionChecker? = null,
|
||||
// Heuristic concept compiler write-side (design 2026-07-12-acr-concept-compiler.md). Null disables
|
||||
// the promotion hook (tests). Live-only like the subscriptions below — never runs under replay.
|
||||
private val conceptCompilerService: com.correx.apps.server.concept.ConceptCompilerService? = null,
|
||||
// Live, swappable config. Null only in tests that don't exercise config editing; defaults to a
|
||||
// holder seeded from defaults so callers always have a value to read.
|
||||
val configHolder: com.correx.core.config.ConfigHolder =
|
||||
@@ -129,6 +133,9 @@ class ServerModule(
|
||||
// Reads recent commits for POST /tasks/sync-git (git-driven status). Null disables the repo read
|
||||
// (the endpoint then only acts on commits supplied in the request body).
|
||||
val gitCommitReader: com.correx.core.tasks.GitCommitReader? = null,
|
||||
// Optional plain-Git transport for a server-owned checkout. It creates and pushes a per-run
|
||||
// branch; null preserves the ordinary local-workspace lifecycle.
|
||||
private val gitRunBranchTransport: com.correx.apps.server.git.GitRunBranchTransport? = null,
|
||||
) {
|
||||
val approvalCoordinator: ApprovalCoordinator = approvalCoordinator ?: ApprovalCoordinator(
|
||||
orchestrator = orchestrator,
|
||||
@@ -240,6 +247,21 @@ class ServerModule(
|
||||
}
|
||||
.launchIn(moduleScope)
|
||||
}
|
||||
|
||||
// Heuristic concept compiler (design 2026-07-12-acr-concept-compiler.md). Live-only like the
|
||||
// hooks above: subscribeAll() replays nothing and ServerModule is never built under replay, so
|
||||
// promotion never re-fires on restart/replay (invariant #8). A StageCompleted may resolve a
|
||||
// validated failure→fix; re-fold the log and promote any newly-eligible fingerprint. Failures
|
||||
// are logged and swallowed — promotion is best-effort enrichment, never on the stage's path.
|
||||
conceptCompilerService?.let { compiler ->
|
||||
eventStore.subscribeAll()
|
||||
.filter { it.payload is StageCompletedEvent }
|
||||
.onEach {
|
||||
runCatching { compiler.runOnce() }
|
||||
.onFailure { e -> log.warn("concept compiler run failed: {}", e.message) }
|
||||
}
|
||||
.launchIn(moduleScope)
|
||||
}
|
||||
}
|
||||
|
||||
/**
|
||||
@@ -358,10 +380,11 @@ class ServerModule(
|
||||
// Record the repo map + seed prior-session memory before the run so stages
|
||||
// see both in context.
|
||||
projectMemory?.let { pm ->
|
||||
val root = sessionWorkspaceRoot(sessionId)
|
||||
runCatching {
|
||||
pm.observeAndRecord(sessionId, pm.repoRoot())
|
||||
pm.indexAndRecord(sessionId, pm.repoRoot())
|
||||
pm.retrieveAndSeed(sessionId, pm.repoRoot())
|
||||
pm.observeAndRecord(sessionId, root)
|
||||
pm.indexAndRecord(sessionId, root)
|
||||
pm.retrieveAndSeed(sessionId, root)
|
||||
}
|
||||
}
|
||||
// Bind operator profile snapshot as an event so replay reads the recorded
|
||||
@@ -390,10 +413,11 @@ class ServerModule(
|
||||
bindProjectProfile(sessionId)
|
||||
bindAgentInstructions(sessionId)
|
||||
runCatching {
|
||||
suspend fun runAndFinalize() {
|
||||
val result = orchestrator.run(sessionId, graph, sessionConfig)
|
||||
freestyleHandoff(sessionId, graph, result)
|
||||
// Distil this run's decisions into durable project memory on completion.
|
||||
projectMemory?.let { pm -> pm.persist(sessionId, pm.repoRoot()) }
|
||||
projectMemory?.let { pm -> pm.persist(sessionId, sessionWorkspaceRoot(sessionId)) }
|
||||
// Propose learned profile adaptations based on session journal (opt-in, never auto-applied).
|
||||
operatorProfile?.let { profile ->
|
||||
profileAdaptationService?.let { svc ->
|
||||
@@ -401,6 +425,13 @@ class ServerModule(
|
||||
.onFailure { log.warn("Profile adaptation failed: {}", it.message) }
|
||||
}
|
||||
}
|
||||
}
|
||||
val workspaceRoot = sessionConfig.workspace?.workspaceRoot
|
||||
if (gitRunBranchTransport != null && workspaceRoot != null) {
|
||||
gitRunBranchTransport.onRunBranch(sessionId, workspaceRoot) { runAndFinalize() }
|
||||
} else {
|
||||
runAndFinalize()
|
||||
}
|
||||
}.onFailure { ex -> recordUnhandledFailure(sessionId, graph, sessionConfig, ex) }
|
||||
activeSessionJobs.remove(sessionId)
|
||||
}
|
||||
@@ -468,6 +499,17 @@ class ServerModule(
|
||||
* router chat triage, and replay read the recorded snapshot, never the live file
|
||||
* (invariants #8/#9). Shared by the workflow path and the chat-session path.
|
||||
*/
|
||||
/**
|
||||
* The session's bound workspace root — the same one the tool jail and [SessionWorkspaceBoundEvent]
|
||||
* use. The repo-map/index/L3-memory pipeline MUST key off this, not [ProjectMemoryService.repoRoot]
|
||||
* (a session-independent config/cwd default): when they diverge the repo map is computed for a
|
||||
* different tree than the session operates in, so grounding "proves" real paths absent
|
||||
* (session 5fe538f5, 2026-07-19). Falls back to the server default only when unbound.
|
||||
*/
|
||||
private fun sessionWorkspaceRoot(sessionId: SessionId): String =
|
||||
runCatching { sessionRepository.getSession(sessionId).state.boundWorkspace?.workspaceRoot }
|
||||
.getOrNull() ?: projectMemory?.repoRoot() ?: "."
|
||||
|
||||
suspend fun bindProjectProfile(sessionId: SessionId) {
|
||||
val workspaceRoot = runCatching {
|
||||
sessionRepository.getSession(sessionId).state.boundWorkspace?.workspaceRoot
|
||||
|
||||
@@ -0,0 +1,112 @@
|
||||
package com.correx.apps.server.concept
|
||||
|
||||
import com.correx.core.events.events.ConceptPromotedEvent
|
||||
import com.correx.core.events.events.EventMetadata
|
||||
import com.correx.core.events.events.NewEvent
|
||||
import com.correx.core.events.stores.EventStore
|
||||
import com.correx.core.events.types.EventId
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.inference.Embedder
|
||||
import com.correx.core.kernel.concept.ConceptCluster
|
||||
import com.correx.core.kernel.concept.ConceptCompilerProjection
|
||||
import com.correx.core.kernel.concept.DEFAULT_PROMOTION_THRESHOLD
|
||||
import com.correx.core.talkie.l3.L3MemoryEntry
|
||||
import com.correx.core.talkie.l3.L3MemoryStore
|
||||
import kotlinx.coroutines.CancellationException
|
||||
import kotlinx.datetime.Clock
|
||||
import org.slf4j.LoggerFactory
|
||||
import java.util.UUID
|
||||
|
||||
private val log = LoggerFactory.getLogger(ConceptCompilerService::class.java)
|
||||
|
||||
/**
|
||||
* The write-side of the heuristic concept compiler (design 2026-07-12-acr-concept-compiler.md).
|
||||
* [ConceptCompilerProjection] does the deterministic clustering; this service is the single "write":
|
||||
* it folds the whole cross-session log, and for every fingerprint that has just become promotable it
|
||||
* appends a [ConceptPromotedEvent] (the authoritative record, idempotent under replay) and best-effort
|
||||
* injects the concept into L3 so it is retrieved on demand into future stage context — the same
|
||||
* pull/top-k path RepoKnowledge already uses, no broadcast. The L3 write is non-authoritative
|
||||
* (invariant #6); the event is truth, so an embed/store failure is logged and swallowed.
|
||||
*
|
||||
* Deterministic rule firing → no assessor gate needed (invariant #3/#7 hold trivially).
|
||||
*
|
||||
* ponytail: [runOnce] re-folds `allEvents()` on each call — O(n) in log size. Fine at local-first
|
||||
* scale and called on stage completions, not per-event. Switch to an incremental in-memory fold over
|
||||
* `subscribeAll()` if the log outgrows a full rescan.
|
||||
*/
|
||||
class ConceptCompilerService(
|
||||
private val eventStore: EventStore,
|
||||
private val embedder: Embedder,
|
||||
private val l3MemoryStore: L3MemoryStore,
|
||||
private val threshold: Int = DEFAULT_PROMOTION_THRESHOLD,
|
||||
) {
|
||||
private val projection = ConceptCompilerProjection()
|
||||
|
||||
/** Fold the full log, promote every newly-promotable fingerprint. Safe to call repeatedly. */
|
||||
suspend fun runOnce() {
|
||||
val state = eventStore.allEvents().fold(projection.initial(), projection::apply)
|
||||
state.promotable(threshold).forEach { promote(it) }
|
||||
}
|
||||
|
||||
private suspend fun promote(cluster: ConceptCluster) {
|
||||
val text = conceptText(cluster)
|
||||
eventStore.append(
|
||||
NewEvent(
|
||||
metadata = metadata(),
|
||||
payload = ConceptPromotedEvent(
|
||||
sessionId = SYSTEM_SESSION,
|
||||
fingerprint = cluster.fingerprint,
|
||||
classKey = cluster.classKey,
|
||||
gate = cluster.gate,
|
||||
conceptText = text,
|
||||
occurrences = cluster.validatedFixes,
|
||||
fixPath = cluster.fixPath,
|
||||
fixHash = cluster.fixHash,
|
||||
),
|
||||
),
|
||||
)
|
||||
injectToL3(cluster.fingerprint, text)
|
||||
log.info("promoted concept {} ({}x, gate={})", cluster.fingerprint, cluster.validatedFixes, cluster.gate)
|
||||
}
|
||||
|
||||
private suspend fun injectToL3(fingerprint: String, text: String) {
|
||||
runCatching {
|
||||
val now = Clock.System.now().toEpochMilliseconds()
|
||||
l3MemoryStore.store(
|
||||
L3MemoryEntry(
|
||||
id = "concept:$fingerprint",
|
||||
sessionId = SYSTEM_SESSION,
|
||||
turnId = "concept:$fingerprint",
|
||||
text = text,
|
||||
vector = embedder.embed(text),
|
||||
timestampMs = now,
|
||||
),
|
||||
)
|
||||
}.exceptionOrNull()?.let { e ->
|
||||
if (e is CancellationException) throw e
|
||||
log.warn("L3 inject failed for concept {}: {}", fingerprint, e.message)
|
||||
}
|
||||
}
|
||||
|
||||
private fun conceptText(c: ConceptCluster): String {
|
||||
val resolution = c.fixPath?.let { path ->
|
||||
" Validated resolution in `$path`" + (c.fixHash?.let { "@$it" } ?: "") + " — inspect it before re-deriving."
|
||||
} ?: " This failure class has a known resolution — check prior fixes before re-deriving."
|
||||
return "Recurring ${c.gate} failure (validated-fixed ${c.validatedFixes}× across sessions): " +
|
||||
"${c.signature}.$resolution"
|
||||
}
|
||||
|
||||
private fun metadata() = EventMetadata(
|
||||
eventId = EventId(UUID.randomUUID().toString()),
|
||||
sessionId = SYSTEM_SESSION,
|
||||
timestamp = Clock.System.now(),
|
||||
schemaVersion = 1,
|
||||
causationId = null,
|
||||
correlationId = null,
|
||||
)
|
||||
|
||||
companion object {
|
||||
/** Cross-session concepts live on their own stream, out of any user session's replay. */
|
||||
val SYSTEM_SESSION = SessionId("__concept_compiler__")
|
||||
}
|
||||
}
|
||||
@@ -1,5 +1,6 @@
|
||||
package com.correx.apps.server.freestyle
|
||||
|
||||
import com.correx.core.events.events.ArtifactValidatedEvent
|
||||
import com.correx.core.events.events.CapabilityGapDetectedEvent
|
||||
import com.correx.core.events.events.CapabilityGapReflectedEvent
|
||||
import com.correx.core.events.events.CapabilityGapVerdict
|
||||
@@ -7,7 +8,13 @@ import com.correx.core.events.events.EventMetadata
|
||||
import com.correx.core.events.events.ExecutionPlanLockedEvent
|
||||
import com.correx.core.events.events.ExecutionPlanRejectedEvent
|
||||
import com.correx.core.events.events.NewEvent
|
||||
import com.correx.core.events.events.PlanGroundingEvaluatedEvent
|
||||
import com.correx.core.events.events.PlanGroundingVerdict
|
||||
import com.correx.core.events.events.PlanLintCompletedEvent
|
||||
import com.correx.core.events.events.ProjectProfileBoundEvent
|
||||
import com.correx.core.events.events.RepoMapComputedEvent
|
||||
import com.correx.core.events.events.WorkflowFailedEvent
|
||||
import com.correx.infrastructure.workflow.PlanGrounder
|
||||
import com.correx.core.tools.contract.ToolCapability
|
||||
import com.correx.infrastructure.workflow.CapabilityGap
|
||||
import com.correx.infrastructure.workflow.CapabilityGapDetector
|
||||
@@ -50,14 +57,28 @@ class FreestyleDriver(
|
||||
// Vikunja #30 part 2: bounded LLM "are you sure?" pass over capability gaps, consulted before
|
||||
// requestPlanApproval. Null = feature degrades to part-1 behavior (gaps recorded, never reflected).
|
||||
private val reflector: CapabilityGapReflector? = null,
|
||||
// Return-to-architect loop: on a grounding rejection, re-run the planning workflow from the
|
||||
// architect stage so it emits a corrected plan (the grounding findings are injected into its
|
||||
// context by buildGroundingFeedbackEntry). Null = no loop; grounding rejection is terminal.
|
||||
private val rerunArchitect: (suspend (SessionId) -> WorkflowResult)? = null,
|
||||
// Max grounding-driven architect re-runs before the plan is rejected for good.
|
||||
private val maxGroundingRetries: Int = 2,
|
||||
) {
|
||||
@Suppress("ReturnCount") // sequential gate pipeline: each gate is a guard-return, same as the engines
|
||||
suspend fun lockAndRun(sessionId: SessionId) {
|
||||
// Return-to-architect loop: each pass compiles + gates the current execution_plan. A grounding
|
||||
// rejection with budget left re-runs the architect (which emits a corrected plan) and loops;
|
||||
// every other gate failure — and grounding once the budget is spent — is terminal.
|
||||
var groundingRetries = 0
|
||||
while (true) {
|
||||
val json = planContent(sessionId) ?: run {
|
||||
log.warn("freestyle: no execution_plan content for session={}", sessionId.value)
|
||||
emitRejected(sessionId, "no execution_plan content produced by planning phase", "missing_content")
|
||||
return
|
||||
}
|
||||
val graph = runCatching { compiler.compile(json, "freestyle-${sessionId.value}") }
|
||||
val graph = runCatching {
|
||||
compiler.compile(json, "freestyle-${sessionId.value}", sessionArtifacts(sessionId))
|
||||
}
|
||||
.getOrElse {
|
||||
log.error("freestyle: plan failed to compile: {}", it.message)
|
||||
emitRejected(sessionId, "plan failed to compile: ${it.message}", "compile")
|
||||
@@ -76,6 +97,33 @@ class FreestyleDriver(
|
||||
emitRejected(sessionId, "plan failed lint: $summary", "lint")
|
||||
return
|
||||
}
|
||||
// Plan grounding (design 2026-07-15 seam 1) before lock: check the compiled plan against the
|
||||
// session's recorded workspace facts (repo map + profile commands). A build stage aimed at a
|
||||
// prerequisite nothing creates is doomed. Deterministic + pure over recorded events (#8/#9).
|
||||
val groundingFailure = groundPlan(sessionId, graph)
|
||||
if (groundingFailure != null) {
|
||||
if (groundingRetries < maxGroundingRetries && rerunArchitect != null) {
|
||||
groundingRetries++
|
||||
log.info(
|
||||
"freestyle: grounding returned plan to architect (attempt {}/{}) session={}: {}",
|
||||
groundingRetries, maxGroundingRetries, sessionId.value, groundingFailure,
|
||||
)
|
||||
// Re-run the architect stage; it sees the recorded grounding findings via
|
||||
// buildGroundingFeedbackEntry and emits a corrected plan. Then loop and re-gate.
|
||||
rerunArchitect.invoke(sessionId)
|
||||
continue
|
||||
}
|
||||
log.warn("freestyle: plan failed grounding for session={}: {}", sessionId.value, groundingFailure)
|
||||
emitRejected(sessionId, "plan failed grounding: $groundingFailure", "grounding")
|
||||
return
|
||||
}
|
||||
lockAndRunGrounded(sessionId, graph, json)
|
||||
return
|
||||
}
|
||||
}
|
||||
|
||||
/** Post-grounding tail of [lockAndRun]: capability gaps, plan-approval, lock, phase-2 handoff. */
|
||||
private suspend fun lockAndRunGrounded(sessionId: SessionId, graph: WorkflowGraph, json: String) {
|
||||
// Capability-gap detector (Vikunja #30 part 1): advisory only — recorded, never blocking.
|
||||
// A gap does not fail the gate and does not grant the missing tool (invariants #3/#4/#5).
|
||||
val gaps = CapabilityGapDetector.detect(graph, toolCapabilities)
|
||||
@@ -127,11 +175,56 @@ class FreestyleDriver(
|
||||
*/
|
||||
fun compiledGraph(sessionId: SessionId): WorkflowGraph? {
|
||||
val json = planContent(sessionId) ?: return null
|
||||
return runCatching { compiler.compile(json, "freestyle-${sessionId.value}") }
|
||||
return runCatching { compiler.compile(json, "freestyle-${sessionId.value}", sessionArtifacts(sessionId)) }
|
||||
.onFailure { log.error("freestyle: plan recompile for resume failed: {}", it.message) }
|
||||
.getOrNull()
|
||||
}
|
||||
|
||||
/** Artifact ids validated earlier in the session (e.g. planning-phase `dod`) for the #264 needs seam. */
|
||||
private fun sessionArtifacts(sessionId: SessionId): Set<String> =
|
||||
eventStore.read(sessionId)
|
||||
.mapNotNull { (it.payload as? ArtifactValidatedEvent)?.artifactId?.value }
|
||||
.toSet()
|
||||
|
||||
/**
|
||||
* Grounds [graph] against recorded workspace facts and emits [PlanGroundingEvaluatedEvent].
|
||||
* Returns null when the plan grounds (PASS), else the findings summary — the caller decides
|
||||
* whether to return the plan to architect or reject it. Missing repo map/profile (fresh session,
|
||||
* no scan) grounds vacuously; the manifest-produced-by-plan check still catches "build with
|
||||
* nothing to build".
|
||||
*/
|
||||
private suspend fun groundPlan(sessionId: SessionId, graph: WorkflowGraph): String? {
|
||||
val events = eventStore.read(sessionId)
|
||||
val repoMap = events.mapNotNull { it.payload as? RepoMapComputedEvent }.lastOrNull()
|
||||
val profile = events.mapNotNull { it.payload as? ProjectProfileBoundEvent }.lastOrNull()
|
||||
val paths = repoMap?.entries?.map { it.path }?.toSet().orEmpty()
|
||||
// No RepoMapComputedEvent = no scan ran, so `paths` is unknown, not "empty workspace".
|
||||
// Tell the grounder not to prove paths absent from a set it never observed (the false
|
||||
// "apps/server/** doesn't exist" reject); the build-manifest check still runs.
|
||||
val result = PlanGrounder.ground(graph, paths, profile?.commands.orEmpty(), scanned = repoMap != null)
|
||||
eventStore.append(
|
||||
NewEvent(
|
||||
metadata = EventMetadata(
|
||||
eventId = EventId(UUID.randomUUID().toString()),
|
||||
sessionId = sessionId,
|
||||
timestamp = Clock.System.now(),
|
||||
schemaVersion = 1,
|
||||
causationId = null,
|
||||
correlationId = null,
|
||||
),
|
||||
payload = PlanGroundingEvaluatedEvent(
|
||||
sessionId = sessionId,
|
||||
planId = graph.id,
|
||||
stateKey = repoMap?.stateKey.orEmpty(),
|
||||
verdict = result.verdict,
|
||||
findings = result.findings,
|
||||
),
|
||||
),
|
||||
)
|
||||
if (result.verdict == PlanGroundingVerdict.PASS) return null
|
||||
return result.findings.joinToString("; ")
|
||||
}
|
||||
|
||||
private suspend fun emitPlanLint(sessionId: SessionId, candidateId: String, lint: PlanLintResult) {
|
||||
eventStore.append(
|
||||
NewEvent(
|
||||
@@ -259,6 +352,28 @@ class FreestyleDriver(
|
||||
),
|
||||
),
|
||||
)
|
||||
// A rejected plan ends the session — but the last workflow verdict on record was the
|
||||
// planning phase's WorkflowCompleted, so the session read as SUCCESS (the "COMPLETED-lie").
|
||||
// Emit a session-terminal WorkflowFailed so the run's true outcome is on the log. stageId is
|
||||
// architect: the plan's producer and where a fix (or future return-to-architect loop) lands.
|
||||
eventStore.append(
|
||||
NewEvent(
|
||||
metadata = EventMetadata(
|
||||
eventId = EventId(UUID.randomUUID().toString()),
|
||||
sessionId = sessionId,
|
||||
timestamp = Clock.System.now(),
|
||||
schemaVersion = 1,
|
||||
causationId = null,
|
||||
correlationId = null,
|
||||
),
|
||||
payload = WorkflowFailedEvent(
|
||||
sessionId = sessionId,
|
||||
stageId = StageId("architect"),
|
||||
reason = "execution plan rejected ($source): $reason",
|
||||
retryExhausted = false,
|
||||
),
|
||||
),
|
||||
)
|
||||
}
|
||||
|
||||
companion object {
|
||||
|
||||
@@ -0,0 +1,120 @@
|
||||
package com.correx.apps.server.git
|
||||
|
||||
import com.correx.core.config.GitConfig
|
||||
import com.correx.core.events.events.EventMetadata
|
||||
import com.correx.core.events.events.NewEvent
|
||||
import com.correx.core.events.events.RunBranchPushedEvent
|
||||
import com.correx.core.events.events.WorkflowCompletedEvent
|
||||
import com.correx.core.events.events.WorkflowFailedEvent
|
||||
import com.correx.core.events.stores.EventStore
|
||||
import com.correx.core.events.types.EventId
|
||||
import com.correx.core.events.types.SessionId
|
||||
import kotlinx.coroutines.Dispatchers
|
||||
import kotlinx.coroutines.sync.Mutex
|
||||
import kotlinx.coroutines.sync.withLock
|
||||
import kotlinx.coroutines.withContext
|
||||
import kotlinx.datetime.Clock
|
||||
import java.nio.file.Path
|
||||
import java.util.UUID
|
||||
import java.util.concurrent.TimeUnit
|
||||
|
||||
private const val GIT_TIMEOUT_SECONDS = 30L
|
||||
|
||||
/**
|
||||
* Plain-Git transport for a server-owned checkout. The mutex intentionally spans a whole run:
|
||||
* checkout is process-global state, so parallel sessions cannot safely share one working tree.
|
||||
*/
|
||||
class GitRunBranchTransport(
|
||||
private val eventStore: EventStore,
|
||||
private val config: GitConfig,
|
||||
) {
|
||||
private val checkoutLock = Mutex()
|
||||
|
||||
suspend fun <T> onRunBranch(
|
||||
sessionId: SessionId,
|
||||
workspaceRoot: Path,
|
||||
block: suspend () -> T,
|
||||
): T = checkoutLock.withLock {
|
||||
val prepared = prepare(sessionId, workspaceRoot)
|
||||
try {
|
||||
block()
|
||||
} finally {
|
||||
val terminalStage = eventStore.read(sessionId).lastOrNull { event ->
|
||||
event.payload is WorkflowCompletedEvent || event.payload is WorkflowFailedEvent
|
||||
}?.payload?.let { payload ->
|
||||
when (payload) {
|
||||
is WorkflowCompletedEvent -> payload.terminalStageId.value
|
||||
is WorkflowFailedEvent -> payload.stageId.value
|
||||
else -> null
|
||||
}
|
||||
} ?: "unknown"
|
||||
pushTerminalBranch(sessionId, workspaceRoot, prepared, terminalStage)
|
||||
}
|
||||
}
|
||||
|
||||
private suspend fun prepare(sessionId: SessionId, workspaceRoot: Path): PreparedBranch = withContext(Dispatchers.IO) {
|
||||
val branch = "run/${sessionId.value}"
|
||||
runGit(workspaceRoot, "fetch", config.remote, config.baseBranch)
|
||||
val baseRef = "${config.remote}/${config.baseBranch}"
|
||||
val baseSha = runGit(workspaceRoot, "rev-parse", baseRef).trim()
|
||||
runGit(workspaceRoot, "checkout", "-B", branch, baseRef)
|
||||
PreparedBranch(branch, baseSha)
|
||||
}
|
||||
|
||||
private suspend fun pushTerminalBranch(
|
||||
sessionId: SessionId,
|
||||
workspaceRoot: Path,
|
||||
prepared: PreparedBranch,
|
||||
terminalStage: String,
|
||||
) =
|
||||
withContext(Dispatchers.IO) {
|
||||
runGit(workspaceRoot, "add", "-A")
|
||||
if (runGitExitCode(workspaceRoot, "diff", "--cached", "--quiet") != 0) {
|
||||
val args = mutableListOf("commit", "-m", "correx run ${sessionId.value} terminal $terminalStage")
|
||||
if (config.author.isNotBlank()) args += "--author=${config.author}"
|
||||
runGit(workspaceRoot, *args.toTypedArray())
|
||||
}
|
||||
val headSha = runGit(workspaceRoot, "rev-parse", "HEAD").trim()
|
||||
runGit(workspaceRoot, "push", config.remote, "${prepared.branch}:${prepared.branch}")
|
||||
eventStore.append(
|
||||
NewEvent(
|
||||
metadata = EventMetadata(
|
||||
eventId = EventId(UUID.randomUUID().toString()),
|
||||
sessionId = sessionId,
|
||||
timestamp = Clock.System.now(),
|
||||
schemaVersion = 1,
|
||||
causationId = null,
|
||||
correlationId = null,
|
||||
),
|
||||
payload = RunBranchPushedEvent(sessionId, prepared.branch, prepared.baseSha, headSha),
|
||||
),
|
||||
)
|
||||
}
|
||||
|
||||
private fun runGit(root: Path, vararg args: String): String {
|
||||
val process = ProcessBuilder(listOf("git", "-C", root.toString()) + args)
|
||||
.redirectErrorStream(true)
|
||||
.start()
|
||||
val output = process.inputStream.bufferedReader().use { it.readText() }
|
||||
if (!process.waitFor(GIT_TIMEOUT_SECONDS, TimeUnit.SECONDS)) {
|
||||
process.destroyForcibly()
|
||||
error("git ${args.joinToString(" ")} timed out")
|
||||
}
|
||||
check(process.exitValue() == 0) { "git ${args.joinToString(" ")} failed: ${output.trim()}" }
|
||||
return output
|
||||
}
|
||||
|
||||
private fun runGitExitCode(root: Path, vararg args: String): Int {
|
||||
val process = ProcessBuilder(listOf("git", "-C", root.toString()) + args)
|
||||
.redirectErrorStream(true)
|
||||
.start()
|
||||
process.inputStream.bufferedReader().use { it.readText() }
|
||||
if (!process.waitFor(GIT_TIMEOUT_SECONDS, TimeUnit.SECONDS)) {
|
||||
process.destroyForcibly()
|
||||
error("git ${args.joinToString(" ")} timed out")
|
||||
}
|
||||
return process.exitValue()
|
||||
}
|
||||
|
||||
private data class PreparedBranch(val branch: String, val baseSha: String)
|
||||
}
|
||||
+1
-1
@@ -19,7 +19,7 @@ import com.correx.core.talkie.l3.L3Query
|
||||
* [ProjectMemoryService] under `turnId = "project:<repoRoot>"` (trailing-`:` delimiter). This is
|
||||
* the only decision-bearing L3 namespace that exists today, so [decisionNamespacePrefix] defaults
|
||||
* to `"project:"` — a `startsWith` prefix, matching the trailing-`:` delimiter convention used by
|
||||
* [L3RepoKnowledgeRetriever]'s `"repomap:<repoRoot>:"` filter. Hits are also constrained to PRIOR
|
||||
* [L3RepoKnowledgeRetriever]'s versioned `"repomap:v2:<repoRoot>:"` filter. Hits are also constrained to PRIOR
|
||||
* sessions (`entry.sessionId != sessionId`) so the architect never flags its own in-flight run.
|
||||
*/
|
||||
class ArchitectContradictionChecker(
|
||||
|
||||
+3
-2
@@ -35,8 +35,9 @@ class L3RepoKnowledgeRetriever(
|
||||
override suspend fun retrieve(sessionId: SessionId, query: String, k: Int): List<RepoKnowledgeHit> {
|
||||
val vector = embedder.embed(query)
|
||||
val candidates = l3MemoryStore.query(L3Query(vector = vector, k = k * RETRIEVAL_OVERSAMPLE_FACTOR))
|
||||
// Trailing ':' so "/repo" does not also match "/repo2" turnIds (prefix collision).
|
||||
.filter { it.entry.turnId.startsWith("repomap:$repoRoot:") }
|
||||
// Versioned trailing delimiter keeps sibling repo roots isolated and stale semantic
|
||||
// documents out after a repo-map descriptor format change.
|
||||
.filter { it.entry.turnId.startsWith(repoMapEmbeddingPrefix(repoRoot)) }
|
||||
val (kept, dropped) = candidates.partition { it.score >= MIN_SIMILARITY_SCORE }
|
||||
if (dropped.isNotEmpty()) recordDropped(sessionId, query, dropped.map { it.toHit() })
|
||||
return kept.take(k).map { it.toHit() }
|
||||
|
||||
@@ -110,13 +110,13 @@ class ProjectMemoryService(
|
||||
stateKey: String?,
|
||||
entries: List<RepoMapEntry>,
|
||||
) {
|
||||
if (stateKey != null && l3MemoryStore.existsByTurnIdPrefix("repomap:$repoRoot:$stateKey")) {
|
||||
val tag = repoMapEmbeddingTag(repoRoot, stateKey)
|
||||
if (stateKey != null && l3MemoryStore.existsByTurnIdPrefix(tag)) {
|
||||
log.debug("repo-map already embedded for {}@{} — skipping L3 store", repoRoot, stateKey)
|
||||
return
|
||||
}
|
||||
// Trailing ':' delimiter so a repoRoot prefix can't collide with a longer sibling
|
||||
// (/repo vs /repo2) under the retriever's startsWith filter.
|
||||
val tag = if (stateKey != null) "repomap:$repoRoot:$stateKey" else "repomap:$repoRoot:"
|
||||
// Docs are already surfaced via the "Docs available" catalog built straight from
|
||||
// RepoMapComputedEvent (SessionOrchestrator, 2026-07-07 doc-injection rework) — embedding
|
||||
// them into the same L3 namespace as code let generic textual similarity (e.g. "analyst",
|
||||
@@ -126,7 +126,11 @@ class ProjectMemoryService(
|
||||
// rather than the repo-map floor that was fixed then).
|
||||
entries.filterNot { it.path.endsWith(".md", ignoreCase = true) }.forEach { entry ->
|
||||
runCatching {
|
||||
val text = entry.path + if (entry.symbols.isEmpty()) "" else ": ${entry.symbols.joinToString(", ")}"
|
||||
val text = buildString {
|
||||
append(entry.path)
|
||||
if (entry.descriptor.isNotBlank()) append(": ").append(entry.descriptor)
|
||||
if (entry.symbols.isNotEmpty()) append("; symbols: ").append(entry.symbols.joinToString(", "))
|
||||
}
|
||||
l3MemoryStore.store(
|
||||
L3MemoryEntry(
|
||||
id = UUID.randomUUID().toString(),
|
||||
|
||||
@@ -0,0 +1,14 @@
|
||||
package com.correx.apps.server.memory
|
||||
|
||||
/**
|
||||
* Version the serialized repo-map embedding namespace. A descriptor change alters the semantic
|
||||
* document, so a new version deliberately ignores stale vectors and causes one re-embed per
|
||||
* recorded workspace state. The recorded repo-map event remains backwards compatible.
|
||||
*/
|
||||
internal const val REPO_MAP_EMBEDDING_VERSION = "v2"
|
||||
|
||||
internal fun repoMapEmbeddingPrefix(repoRoot: String): String =
|
||||
"repomap:$REPO_MAP_EMBEDDING_VERSION:$repoRoot:"
|
||||
|
||||
internal fun repoMapEmbeddingTag(repoRoot: String, stateKey: String?): String =
|
||||
stateKey?.let { repoMapEmbeddingPrefix(repoRoot) + it } ?: repoMapEmbeddingPrefix(repoRoot)
|
||||
@@ -20,7 +20,8 @@ interface RepoMapIndexerPort {
|
||||
* Walks a repo and produces a ranked file/symbol index. Reads the filesystem (a
|
||||
* nondeterministic environment observation) — the caller records the result as a
|
||||
* [com.correx.core.events.events.RepoMapComputedEvent] so replay reads recorded facts and
|
||||
* never re-scans (invariant #9). Paths + top-level symbol names only, never file bodies.
|
||||
* never re-scans (invariant #9). Entries retain paths, top-level symbols, and a bounded,
|
||||
* deterministic purpose descriptor; full file bodies are never stored in the repo map.
|
||||
*
|
||||
* Scoring is recency-based: the most-recently-modified source file scores 1.0, the oldest
|
||||
* ~0.0, linearly between. Recency is a cheap centrality proxy — files under active work rank
|
||||
@@ -53,6 +54,7 @@ class RepoMapIndexer(
|
||||
path = path.relativeTo(repoRoot).toString(),
|
||||
score = (mtimes.getValue(path) - min).toDouble() / span,
|
||||
symbols = extractSymbols(path),
|
||||
descriptor = sourceDescriptor(path),
|
||||
)
|
||||
}
|
||||
.sortedByDescending { it.score }
|
||||
@@ -104,6 +106,35 @@ class RepoMapIndexer(
|
||||
} ?: emptyList()
|
||||
}
|
||||
|
||||
/**
|
||||
* A small semantic bridge between an intent ("context packing") and code whose class name
|
||||
* alone lacks those words. Package/module identity, leading KDoc/comments, and imports are
|
||||
* stable source facts; they are capped before the event and L3 embedding are recorded.
|
||||
*/
|
||||
private fun sourceDescriptor(path: Path): String {
|
||||
if (path.extension.equals("md", ignoreCase = true)) return docDescriptor(path).orEmpty()
|
||||
val lines = runCatching { path.readText().lineSequence().take(DESCRIPTOR_SCAN_LINES).toList() }
|
||||
.getOrDefault(emptyList())
|
||||
if (lines.isEmpty()) return ""
|
||||
val packageOrModule = lines.firstNotNullOfOrNull { line ->
|
||||
PACKAGE_OR_MODULE.find(line.trim())?.groupValues?.get(1)
|
||||
}
|
||||
val imports = lines.asSequence()
|
||||
.mapNotNull { IMPORT.find(it.trim())?.groupValues?.get(1) }
|
||||
.take(MAX_DESCRIPTOR_IMPORTS)
|
||||
.toList()
|
||||
val comment = lines.asSequence()
|
||||
.map { raw -> raw.trim() }
|
||||
.filter(::isCommentLine)
|
||||
.map { it.removePrefix("/**").removePrefix("*").removePrefix("//").removePrefix("#").trim() }
|
||||
.firstOrNull { it.length >= MIN_COMMENT_CHARS }
|
||||
return buildList {
|
||||
packageOrModule?.let { add("module $it") }
|
||||
if (imports.isNotEmpty()) add("uses ${imports.joinToString(", ")}")
|
||||
comment?.let { add(it) }
|
||||
}.joinToString("; ").truncateDescriptor()
|
||||
}
|
||||
|
||||
/**
|
||||
* One-line "what is this doc about" descriptor, preferred in order: YAML frontmatter
|
||||
* `description`/`summary`/`title`, then the first `# H1` heading, then the first prose line.
|
||||
@@ -133,13 +164,21 @@ class RepoMapIndexer(
|
||||
private fun String.truncateDescriptor(): String =
|
||||
if (length <= MAX_DESCRIPTOR_CHARS) this else take(MAX_DESCRIPTOR_CHARS).trimEnd() + "…"
|
||||
|
||||
private fun isCommentLine(line: String): Boolean =
|
||||
line.startsWith("/**") || line.startsWith("*") || line.startsWith("//") || line.startsWith("#")
|
||||
|
||||
companion object {
|
||||
/** File extensions considered for indexing — reused by [WorkspaceStateProbe] for fingerprinting. */
|
||||
val INDEXED_EXTENSIONS: Set<String> get() = SYMBOL_PATTERNS.keys
|
||||
|
||||
private const val MAX_SYMBOLS_PER_FILE = 40
|
||||
private const val MAX_DESCRIPTOR_CHARS = 120
|
||||
private const val DESCRIPTOR_SCAN_LINES = 80
|
||||
private const val MAX_DESCRIPTOR_IMPORTS = 6
|
||||
private const val MIN_COMMENT_CHARS = 16
|
||||
private val FRONTMATTER_KEYS = listOf("description", "summary", "title")
|
||||
private val PACKAGE_OR_MODULE = Regex("""(?:package|module|namespace)\s+([A-Za-z0-9_.$/-]+)""")
|
||||
private val IMPORT = Regex("""(?:import|using)\s+([A-Za-z0-9_.$/*-]+)""")
|
||||
|
||||
// Top-level declarations only — best-effort per language. Bodies/locals are never matched.
|
||||
val SYMBOL_PATTERNS: Map<String, Regex> = mapOf(
|
||||
|
||||
@@ -0,0 +1,38 @@
|
||||
package com.correx.apps.server.routes
|
||||
|
||||
import com.correx.apps.server.ServerModule
|
||||
import com.correx.core.events.events.ClarificationAnswer
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.utils.TypeId
|
||||
import io.ktor.http.HttpStatusCode
|
||||
import io.ktor.server.request.receive
|
||||
import io.ktor.server.response.respond
|
||||
import io.ktor.server.routing.Route
|
||||
import io.ktor.server.routing.post
|
||||
import kotlinx.serialization.Serializable
|
||||
|
||||
// REST parity for stage clarifications (WS already has ClientMessage.ClarificationResponse). Keyed by
|
||||
// session — the server resolves the live pending (stageId, requestId) so a headless run (a script,
|
||||
// `correx run`) can clear a discovery-stage clarification without a WebSocket. If the caller omits the
|
||||
// answer for a question, its value is the empty string (free-text skip). Fixes Vikunja #42.
|
||||
@Serializable
|
||||
data class ClarifyStageRequest(val answers: List<ClarificationAnswer>)
|
||||
|
||||
internal fun Route.clarifyStageRoute(module: ServerModule) {
|
||||
post("/clarify") {
|
||||
val id = call.parameters["id"]
|
||||
if (id == null) {
|
||||
call.respond(HttpStatusCode.BadRequest, "Missing session id")
|
||||
return@post
|
||||
}
|
||||
val sessionId: SessionId = TypeId(id)
|
||||
val pending = module.orchestrator.pendingClarificationFor(sessionId)
|
||||
if (pending == null) {
|
||||
call.respond(HttpStatusCode.NotFound, "No pending clarification for session $id")
|
||||
return@post
|
||||
}
|
||||
val answers = call.receive<ClarifyStageRequest>().answers
|
||||
module.orchestrator.submitClarification(sessionId, pending.stageId, pending.requestId, answers)
|
||||
call.respond(HttpStatusCode.OK)
|
||||
}
|
||||
}
|
||||
@@ -100,6 +100,7 @@ fun Route.sessionRoutes(module: ServerModule) {
|
||||
getSessionRoute(module)
|
||||
cancelSessionRoute(module)
|
||||
approveStageRoute(module)
|
||||
clarifyStageRoute(module)
|
||||
approveSourcesRoute(module)
|
||||
undoSessionRoute(module)
|
||||
resumeSessionRoute(module)
|
||||
|
||||
@@ -0,0 +1,61 @@
|
||||
package com.correx.apps.server
|
||||
|
||||
import com.correx.core.config.ProjectConfig
|
||||
import java.nio.file.Path
|
||||
import kotlin.test.assertEquals
|
||||
import kotlin.test.assertFalse
|
||||
import kotlin.test.assertTrue
|
||||
import org.junit.jupiter.api.Test
|
||||
|
||||
class BootWorkspaceTest {
|
||||
@Test
|
||||
fun `workspace root clamps an outside configured working directory`() {
|
||||
val resolved = resolveBootWorkspace(
|
||||
explicitWorkspaceRoot = Path.of("/tmp/audition"),
|
||||
explicitWorkingDir = Path.of("/home/user/repo"),
|
||||
processWorkingDir = Path.of("/home/user/repo"),
|
||||
)
|
||||
|
||||
assertEquals(Path.of("/tmp/audition"), resolved.workspaceRoot)
|
||||
assertEquals(Path.of("/tmp/audition"), resolved.workingDir)
|
||||
assertTrue(resolved.workingDirWasClamped)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `working directory inside workspace root remains intact`() {
|
||||
val resolved = resolveBootWorkspace(
|
||||
explicitWorkspaceRoot = Path.of("/tmp/audition"),
|
||||
explicitWorkingDir = Path.of("/tmp/audition/frontend"),
|
||||
processWorkingDir = Path.of("/home/user/repo"),
|
||||
)
|
||||
|
||||
assertEquals(Path.of("/tmp/audition"), resolved.workspaceRoot)
|
||||
assertEquals(Path.of("/tmp/audition/frontend"), resolved.workingDir)
|
||||
assertFalse(resolved.workingDirWasClamped)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `configured working directory supplies the root when workspace root is absent`() {
|
||||
val resolved = resolveBootWorkspace(
|
||||
explicitWorkspaceRoot = null,
|
||||
explicitWorkingDir = Path.of("/tmp/configured"),
|
||||
processWorkingDir = Path.of("/home/user/repo"),
|
||||
)
|
||||
|
||||
assertEquals(Path.of("/tmp/configured"), resolved.workspaceRoot)
|
||||
assertEquals(Path.of("/tmp/configured"), resolved.workingDir)
|
||||
assertFalse(resolved.workingDirWasClamped)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `project memory root follows the authoritative workspace root`() {
|
||||
val configured = ProjectConfig(
|
||||
enabled = true,
|
||||
root = "/home/user/repo",
|
||||
)
|
||||
|
||||
val resolved = configured.boundToWorkspace(Path.of("/tmp/audition/../audition"))
|
||||
|
||||
assertEquals("/tmp/audition", resolved.root)
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,47 @@
|
||||
package com.correx.apps.server
|
||||
|
||||
import com.correx.core.approvals.Tier
|
||||
import com.correx.core.events.events.ToolRequest
|
||||
import com.correx.core.tools.contract.Tool
|
||||
import com.correx.core.tools.contract.ToolCapability
|
||||
import com.correx.core.tools.contract.ToolExecutor
|
||||
import com.correx.core.tools.contract.ToolResult
|
||||
import com.correx.core.tools.contract.ValidationResult
|
||||
import kotlinx.coroutines.runBlocking
|
||||
import kotlinx.serialization.json.JsonObject
|
||||
import org.junit.jupiter.api.Test
|
||||
import org.slf4j.LoggerFactory
|
||||
import java.nio.file.Path
|
||||
import kotlin.test.assertEquals
|
||||
import kotlin.test.assertNull
|
||||
|
||||
class McpIndexBootstrapTest {
|
||||
private val log = LoggerFactory.getLogger("test")
|
||||
|
||||
private class FakeTool(override val name: String) : Tool, ToolExecutor {
|
||||
var seen: ToolRequest? = null
|
||||
override val description = ""
|
||||
override val parametersSchema = JsonObject(emptyMap())
|
||||
override val tier = Tier.T2
|
||||
override val requiredCapabilities = emptySet<ToolCapability>()
|
||||
override fun validateRequest(request: ToolRequest) = ValidationResult.Valid
|
||||
override suspend fun execute(request: ToolRequest): ToolResult {
|
||||
seen = request
|
||||
return ToolResult.Success(request.invocationId, "indexed")
|
||||
}
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `calls index_repository with repo_path set to the workspace root`() = runBlocking {
|
||||
val index = FakeTool("mcp__codebase-memory__index_repository")
|
||||
bootstrapCodebaseIndex(listOf(FakeTool("mcp__x__search_code"), index), Path.of("/repo"), log)
|
||||
assertEquals("/repo", index.seen?.parameters?.get("repo_path"))
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `no-op when no index_repository tool is mounted`() = runBlocking {
|
||||
val other = FakeTool("mcp__x__search_code")
|
||||
bootstrapCodebaseIndex(listOf(other), Path.of("/repo"), log)
|
||||
assertNull(other.seen)
|
||||
}
|
||||
}
|
||||
+109
@@ -0,0 +1,109 @@
|
||||
package com.correx.apps.server.concept
|
||||
|
||||
import com.correx.core.events.events.ConceptPromotedEvent
|
||||
import com.correx.core.events.events.EventMetadata
|
||||
import com.correx.core.events.events.EventPayload
|
||||
import com.correx.core.events.events.NewEvent
|
||||
import com.correx.core.events.events.RetryAttemptedEvent
|
||||
import com.correx.core.events.events.StageCompletedEvent
|
||||
import com.correx.core.events.stores.EventStore
|
||||
import com.correx.core.events.types.EventId
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.events.types.StageId
|
||||
import com.correx.core.events.types.TransitionId
|
||||
import com.correx.core.inference.Embedder
|
||||
import com.correx.core.talkie.l3.InMemoryL3MemoryStore
|
||||
import com.correx.core.talkie.l3.L3Query
|
||||
import com.correx.infrastructure.persistence.InMemoryEventStore
|
||||
import kotlinx.coroutines.flow.toList
|
||||
import kotlinx.coroutines.runBlocking
|
||||
import kotlinx.datetime.Clock
|
||||
import org.junit.jupiter.api.Assertions.assertEquals
|
||||
import org.junit.jupiter.api.Assertions.assertTrue
|
||||
import org.junit.jupiter.api.Test
|
||||
import java.util.UUID
|
||||
|
||||
private class ConstantEmbedder(override val dimension: Int = 8) : Embedder {
|
||||
override suspend fun embed(text: String): FloatArray = FloatArray(dimension) { 1f }
|
||||
}
|
||||
|
||||
class ConceptCompilerServiceTest {
|
||||
|
||||
private val store = InMemoryEventStore()
|
||||
private val l3 = InMemoryL3MemoryStore()
|
||||
private val service = ConceptCompilerService(store, ConstantEmbedder(), l3, threshold = 3)
|
||||
|
||||
private suspend fun append(payload: EventPayload, session: String) {
|
||||
store.append(
|
||||
NewEvent(
|
||||
metadata = EventMetadata(
|
||||
eventId = EventId(UUID.randomUUID().toString()),
|
||||
sessionId = SessionId(session),
|
||||
timestamp = Clock.System.now(),
|
||||
schemaVersion = 1,
|
||||
causationId = null,
|
||||
correlationId = null,
|
||||
),
|
||||
payload = payload,
|
||||
),
|
||||
)
|
||||
}
|
||||
|
||||
private suspend fun validatedFix(fp: String, session: String) {
|
||||
append(
|
||||
RetryAttemptedEvent(
|
||||
sessionId = SessionId(session),
|
||||
stageId = StageId("impl"),
|
||||
attemptNumber = 1,
|
||||
maxAttempts = 3,
|
||||
failureReason = "detekt: MagicNumber\ntrace",
|
||||
gate = "lint",
|
||||
fingerprint = fp,
|
||||
),
|
||||
session,
|
||||
)
|
||||
append(StageCompletedEvent(SessionId(session), StageId("impl"), TransitionId("t")), session)
|
||||
}
|
||||
|
||||
private suspend fun promotedEvents(): List<ConceptPromotedEvent> =
|
||||
store.allEvents().mapNotNull { it.payload as? ConceptPromotedEvent }.toList()
|
||||
|
||||
@Test
|
||||
fun `promotes a fingerprint that crossed the threshold and injects it into L3`(): Unit = runBlocking {
|
||||
validatedFix("fp1", "sa")
|
||||
validatedFix("fp1", "sb")
|
||||
validatedFix("fp1", "sc")
|
||||
|
||||
service.runOnce()
|
||||
|
||||
val promoted = promotedEvents()
|
||||
assertEquals(1, promoted.size)
|
||||
assertEquals("fp1", promoted.single().fingerprint)
|
||||
assertEquals(3, promoted.single().occurrences)
|
||||
|
||||
val hits = l3.query(L3Query(vector = FloatArray(8) { 1f }, k = 5))
|
||||
assertTrue(hits.any { it.entry.turnId == "concept:fp1" }) { "concept not injected into L3" }
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `does not promote below the threshold`(): Unit = runBlocking {
|
||||
validatedFix("fp1", "sa")
|
||||
validatedFix("fp1", "sb")
|
||||
|
||||
service.runOnce()
|
||||
|
||||
assertTrue(promotedEvents().isEmpty())
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `repeated runs do not re-promote the same fingerprint`(): Unit = runBlocking {
|
||||
validatedFix("fp1", "sa")
|
||||
validatedFix("fp1", "sb")
|
||||
validatedFix("fp1", "sc")
|
||||
|
||||
service.runOnce()
|
||||
service.runOnce()
|
||||
|
||||
assertEquals(1, promotedEvents().size)
|
||||
}
|
||||
}
|
||||
@@ -6,9 +6,14 @@ import com.correx.core.artifacts.kind.JsonSchema
|
||||
import com.correx.core.events.events.CapabilityGapDetectedEvent
|
||||
import com.correx.core.events.events.CapabilityGapReflectedEvent
|
||||
import com.correx.core.events.events.CapabilityGapVerdict
|
||||
import com.correx.core.events.events.EventMetadata
|
||||
import com.correx.core.events.events.ExecutionPlanLockedEvent
|
||||
import com.correx.core.events.events.ExecutionPlanRejectedEvent
|
||||
import com.correx.core.events.events.NewEvent
|
||||
import com.correx.core.events.events.PlanLintCompletedEvent
|
||||
import com.correx.core.events.events.RepoMapComputedEvent
|
||||
import com.correx.core.events.events.RepoMapEntry
|
||||
import com.correx.core.events.types.EventId
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.kernel.execution.WorkflowResult
|
||||
import com.correx.core.kernel.orchestration.CapabilityGapReflection
|
||||
@@ -18,6 +23,8 @@ import com.correx.core.transitions.graph.WorkflowGraph
|
||||
import com.correx.infrastructure.persistence.InMemoryEventStore
|
||||
import com.correx.infrastructure.workflow.ExecutionPlanCompiler
|
||||
import kotlinx.coroutines.runBlocking
|
||||
import kotlinx.datetime.Clock
|
||||
import java.util.UUID
|
||||
import org.junit.jupiter.api.Assertions.assertEquals
|
||||
import org.junit.jupiter.api.Assertions.assertFalse
|
||||
import org.junit.jupiter.api.Assertions.assertTrue
|
||||
@@ -471,4 +478,121 @@ class FreestyleDriverTest {
|
||||
assertTrue(payloads.filterIsInstance<CapabilityGapReflectedEvent>().isEmpty())
|
||||
assertEquals(1, payloads.filterIsInstance<ExecutionPlanLockedEvent>().size)
|
||||
}
|
||||
|
||||
// "apply" is scoped to frontend/** — with a scan recorded whose only path is backend/, and no
|
||||
// stage creating a frontend file, scope grounding fails (RETURN_TO_ARCHITECT). Passes lint.
|
||||
private val groundingFailPlanJson = """
|
||||
{
|
||||
"goal": "plan scoped to a path that doesn't exist",
|
||||
"stages": [
|
||||
{ "id": "analyse", "prompt": "Analyse", "produces": "patch", "needs": [], "tools": [] },
|
||||
{ "id": "apply", "prompt": "Apply", "produces": "patch", "needs": ["patch"], "tools": [],
|
||||
"touches": ["frontend/**"] }
|
||||
],
|
||||
"edges": [
|
||||
{ "from": "analyse", "to": "apply", "condition": { "type": "always_true" } },
|
||||
{ "from": "apply", "to": "done", "condition": { "type": "always_true" } }
|
||||
]
|
||||
}
|
||||
""".trimIndent()
|
||||
|
||||
// Records a scan (scanned=true) whose only path is backend/, so frontend/** grounds to nothing.
|
||||
private suspend fun recordBackendScan(store: InMemoryEventStore, sessionId: SessionId) {
|
||||
store.append(
|
||||
NewEvent(
|
||||
metadata = EventMetadata(
|
||||
eventId = EventId(UUID.randomUUID().toString()),
|
||||
sessionId = sessionId,
|
||||
timestamp = Clock.System.now(),
|
||||
schemaVersion = 1,
|
||||
causationId = null,
|
||||
correlationId = null,
|
||||
),
|
||||
payload = RepoMapComputedEvent(
|
||||
sessionId = sessionId,
|
||||
repoRoot = "/ws",
|
||||
entries = listOf(RepoMapEntry(path = "backend/main.kt", score = 1.0)),
|
||||
computedAt = Clock.System.now(),
|
||||
),
|
||||
),
|
||||
)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `grounding failure returns plan to architect then locks once the re-run yields a grounded plan`(): Unit =
|
||||
runBlocking {
|
||||
val sessionId = SessionId("driver-grounding-retry-session")
|
||||
val eventStore = InMemoryEventStore()
|
||||
val compiler = ExecutionPlanCompiler(buildRegistry())
|
||||
recordBackendScan(eventStore, sessionId)
|
||||
|
||||
var corrected = false
|
||||
var rerunInvocations = 0
|
||||
var runPhase2Invocations = 0
|
||||
|
||||
val driver = FreestyleDriver(
|
||||
eventStore = eventStore,
|
||||
compiler = compiler,
|
||||
// Fails grounding until the architect re-run "fixes" it (flips to the unconstrained plan).
|
||||
planContent = { if (corrected) validPlanJson else groundingFailPlanJson },
|
||||
config = OrchestrationConfig(),
|
||||
runPhase2 = { sid, graph, _ ->
|
||||
runPhase2Invocations++
|
||||
WorkflowResult.Completed(sid, graph.start)
|
||||
},
|
||||
rerunArchitect = { sid ->
|
||||
rerunInvocations++
|
||||
corrected = true
|
||||
WorkflowResult.Completed(sid, com.correx.core.events.types.StageId("architect"))
|
||||
},
|
||||
)
|
||||
|
||||
driver.lockAndRun(sessionId)
|
||||
|
||||
assertEquals(1, rerunInvocations, "architect should be re-run exactly once")
|
||||
val payloads = eventStore.read(sessionId).map { it.payload }
|
||||
assertEquals(1, payloads.filterIsInstance<ExecutionPlanLockedEvent>().size, "corrected plan should lock")
|
||||
assertEquals(1, runPhase2Invocations, "runPhase2 should run once on the corrected plan")
|
||||
assertTrue(
|
||||
payloads.filterIsInstance<ExecutionPlanRejectedEvent>().isEmpty(),
|
||||
"no rejection once the re-run grounds",
|
||||
)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `grounding failure that never resolves is rejected with source grounding after exhausting retries`(): Unit =
|
||||
runBlocking {
|
||||
val sessionId = SessionId("driver-grounding-exhaust-session")
|
||||
val eventStore = InMemoryEventStore()
|
||||
val compiler = ExecutionPlanCompiler(buildRegistry())
|
||||
recordBackendScan(eventStore, sessionId)
|
||||
|
||||
var rerunInvocations = 0
|
||||
var runPhase2Invocations = 0
|
||||
|
||||
val driver = FreestyleDriver(
|
||||
eventStore = eventStore,
|
||||
compiler = compiler,
|
||||
planContent = { groundingFailPlanJson }, // never corrected
|
||||
config = OrchestrationConfig(),
|
||||
runPhase2 = { sid, graph, _ ->
|
||||
runPhase2Invocations++
|
||||
WorkflowResult.Completed(sid, graph.start)
|
||||
},
|
||||
rerunArchitect = { sid ->
|
||||
rerunInvocations++
|
||||
WorkflowResult.Completed(sid, com.correx.core.events.types.StageId("architect"))
|
||||
},
|
||||
maxGroundingRetries = 2,
|
||||
)
|
||||
|
||||
driver.lockAndRun(sessionId)
|
||||
|
||||
assertEquals(2, rerunInvocations, "architect re-run should be capped at maxGroundingRetries")
|
||||
assertEquals(0, runPhase2Invocations, "runPhase2 must not run when grounding never clears")
|
||||
val payloads = eventStore.read(sessionId).map { it.payload }
|
||||
assertTrue(payloads.filterIsInstance<ExecutionPlanLockedEvent>().isEmpty(), "never locks")
|
||||
val rejected = payloads.filterIsInstance<ExecutionPlanRejectedEvent>().single()
|
||||
assertEquals("grounding", rejected.source)
|
||||
}
|
||||
}
|
||||
|
||||
@@ -0,0 +1,60 @@
|
||||
package com.correx.apps.server.git
|
||||
|
||||
import com.correx.core.config.GitConfig
|
||||
import com.correx.core.events.events.RunBranchPushedEvent
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.infrastructure.persistence.InMemoryEventStore
|
||||
import kotlinx.coroutines.runBlocking
|
||||
import org.junit.jupiter.api.Test
|
||||
import java.nio.file.Files
|
||||
import java.nio.file.Path
|
||||
import java.util.concurrent.TimeUnit
|
||||
import kotlin.io.path.writeText
|
||||
import kotlin.test.assertEquals
|
||||
import kotlin.test.assertTrue
|
||||
|
||||
class GitRunBranchTransportTest {
|
||||
|
||||
@Test
|
||||
fun `creates a run branch, pushes it, and records the pushed ref`(): Unit = runBlocking {
|
||||
val root = Files.createTempDirectory("correx-git-transport")
|
||||
val remote = Files.createTempDirectory("correx-git-remote")
|
||||
git(root, "init", "-b", "main")
|
||||
git(root, "config", "user.name", "Test User")
|
||||
git(root, "config", "user.email", "test@example.test")
|
||||
root.resolve("README.md").writeText("base\n")
|
||||
git(root, "add", "README.md")
|
||||
git(root, "commit", "-m", "base")
|
||||
git(remote, "init", "--bare")
|
||||
git(root, "remote", "add", "origin", remote.toString())
|
||||
git(root, "push", "origin", "main")
|
||||
|
||||
val store = InMemoryEventStore()
|
||||
val sessionId = SessionId("git-transport")
|
||||
val transport = GitRunBranchTransport(
|
||||
store,
|
||||
GitConfig(enabled = true, remote = "origin", baseBranch = "main"),
|
||||
)
|
||||
|
||||
transport.onRunBranch(sessionId, root) {
|
||||
root.resolve("agent-output.txt").writeText("generated\n")
|
||||
}
|
||||
|
||||
assertEquals("run/git-transport", git(root, "branch", "--show-current").trim())
|
||||
assertTrue(git(root, "ls-remote", "--heads", "origin", "run/git-transport").isNotBlank())
|
||||
val pushed = store.read(sessionId).single().payload as RunBranchPushedEvent
|
||||
assertEquals("run/git-transport", pushed.branch)
|
||||
assertTrue(pushed.baseSha.isNotBlank())
|
||||
assertEquals(git(root, "rev-parse", "HEAD").trim(), pushed.headSha)
|
||||
}
|
||||
|
||||
private fun git(root: Path, vararg args: String): String {
|
||||
val process = ProcessBuilder(listOf("git", "-C", root.toString()) + args)
|
||||
.redirectErrorStream(true)
|
||||
.start()
|
||||
val output = process.inputStream.bufferedReader().use { it.readText() }
|
||||
check(process.waitFor(20, TimeUnit.SECONDS)) { "git ${args.joinToString(" ")} timed out" }
|
||||
check(process.exitValue() == 0) { "git ${args.joinToString(" ")} failed: $output" }
|
||||
return output
|
||||
}
|
||||
}
|
||||
+1
-1
@@ -87,7 +87,7 @@ class ArchitectContradictionCheckerTest {
|
||||
val store = CannedL3MemoryStore(
|
||||
listOf(
|
||||
// Above threshold but a repo-map entry, not a decision — must be excluded.
|
||||
hit("Foo.kt: ClassA, funcB", score = 0.95f, turnId = "repomap:/repo:abc"),
|
||||
hit("Foo.kt: ClassA, funcB", score = 0.95f, turnId = "repomap:v2:/repo:abc"),
|
||||
),
|
||||
)
|
||||
val checker = ArchitectContradictionChecker(ContradictionOnesEmbedder(), store)
|
||||
|
||||
+4
-4
@@ -19,8 +19,8 @@ class L3RepoKnowledgeRetrieverTest {
|
||||
@Test
|
||||
fun `retriever for a repoRoot does not match a sibling whose path it prefixes`(): Unit = runBlocking {
|
||||
val l3 = InMemoryL3MemoryStore()
|
||||
l3.store(L3MemoryEntry("1", SessionId("s"), "repomap:/repo:git:h", "repo/A.kt: Foo", vec, 0L))
|
||||
l3.store(L3MemoryEntry("2", SessionId("s"), "repomap:/repo2:git:h", "repo2/B.kt: Bar", vec, 0L))
|
||||
l3.store(L3MemoryEntry("1", SessionId("s"), "repomap:v2:/repo:git:h", "repo/A.kt: Foo", vec, 0L))
|
||||
l3.store(L3MemoryEntry("2", SessionId("s"), "repomap:v2:/repo2:git:h", "repo2/B.kt: Bar", vec, 0L))
|
||||
|
||||
val hits = L3RepoKnowledgeRetriever(RetrieverConstantEmbedder(), l3, "/repo")
|
||||
.retrieve(SessionId("s"), "anything", 10)
|
||||
@@ -31,8 +31,8 @@ class L3RepoKnowledgeRetrieverTest {
|
||||
@Test
|
||||
fun `retriever matches its own repoRoot entries with or without a stateKey suffix`(): Unit = runBlocking {
|
||||
val l3 = InMemoryL3MemoryStore()
|
||||
l3.store(L3MemoryEntry("1", SessionId("s"), "repomap:/repo:git:h1", "repo/A.kt", vec, 0L))
|
||||
l3.store(L3MemoryEntry("2", SessionId("s"), "repomap:/repo:", "repo/B.kt", vec, 0L))
|
||||
l3.store(L3MemoryEntry("1", SessionId("s"), "repomap:v2:/repo:git:h1", "repo/A.kt", vec, 0L))
|
||||
l3.store(L3MemoryEntry("2", SessionId("s"), "repomap:v2:/repo:", "repo/B.kt", vec, 0L))
|
||||
|
||||
val hits = L3RepoKnowledgeRetriever(RetrieverConstantEmbedder(), l3, "/repo")
|
||||
.retrieve(SessionId("s"), "anything", 10)
|
||||
|
||||
+4
-4
@@ -118,7 +118,7 @@ class ProjectMemoryServiceReuseTest {
|
||||
svc.indexAndRecord(sessionId, "/repo")
|
||||
|
||||
assertTrue(
|
||||
l3.existsByTurnIdPrefix("repomap:/repo:git:hash1"),
|
||||
l3.existsByTurnIdPrefix("repomap:v2:/repo:git:hash1"),
|
||||
"entries should be embedded with stateKey tag",
|
||||
)
|
||||
}
|
||||
@@ -131,7 +131,7 @@ class ProjectMemoryServiceReuseTest {
|
||||
val embedder = ConstantEmbedderReuse()
|
||||
|
||||
// Index /repo and /repo2 into the same shared L3 store with the same stateKey.
|
||||
// The trailing-':' delimiter on the repomap: tag must keep their entries from bleeding
|
||||
// The versioned trailing-':' delimiter on the repomap tag must keep their entries from bleeding
|
||||
// across roots: "/repo" must NOT match tags written for "/repo2".
|
||||
val repoEntries = listOf(RepoMapEntry(path = "src/Repo.kt", score = 1.0, symbols = listOf("RepoClass")))
|
||||
val repo2Entries = listOf(RepoMapEntry(path = "src/Repo2.kt", score = 1.0, symbols = listOf("Repo2Class")))
|
||||
@@ -142,8 +142,8 @@ class ProjectMemoryServiceReuseTest {
|
||||
.indexAndRecord(SessionId("session-collide-repo2"), "/repo2")
|
||||
|
||||
// existsByTurnIdPrefix with the delimiter must not match the other root.
|
||||
assertTrue(l3.existsByTurnIdPrefix("repomap:/repo:"), "tag for /repo should exist")
|
||||
assertTrue(l3.existsByTurnIdPrefix("repomap:/repo2:"), "tag for /repo2 should exist")
|
||||
assertTrue(l3.existsByTurnIdPrefix("repomap:v2:/repo:"), "tag for /repo should exist")
|
||||
assertTrue(l3.existsByTurnIdPrefix("repomap:v2:/repo2:"), "tag for /repo2 should exist")
|
||||
|
||||
// The retriever scoped to /repo must return only /repo's entry, never /repo2's.
|
||||
val hits = L3RepoKnowledgeRetriever(embedder = embedder, l3MemoryStore = l3, repoRoot = "/repo")
|
||||
|
||||
@@ -41,6 +41,40 @@ class RepoMapIndexerTest {
|
||||
assertTrue(entries.first { it.path == "Old.kt" }.symbols.contains("Old"))
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `source descriptor retains package imports and leading purpose comment`(@TempDir root: Path) {
|
||||
root.resolve("src").createDirectories()
|
||||
root.resolve("src/Context.kt").writeText(
|
||||
"""
|
||||
/** Builds the context packing pipeline for stage inference. */
|
||||
package com.correx.context
|
||||
import com.correx.events.EventStore
|
||||
class DefaultContextPackBuilder
|
||||
""".trimIndent(),
|
||||
)
|
||||
|
||||
val entry = RepoMapIndexer().index(root).single()
|
||||
|
||||
assertTrue(entry.descriptor.contains("module com.correx.context"))
|
||||
assertTrue(entry.descriptor.contains("EventStore"))
|
||||
assertTrue(entry.descriptor.contains("context packing pipeline"))
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `source descriptor never uses a declaration as a purpose comment`(@TempDir root: Path) {
|
||||
root.resolve("Plain.kt").writeText(
|
||||
"""
|
||||
package com.correx.example
|
||||
import com.correx.events.EventStore
|
||||
class ALongEnoughDeclarationToHaveLookedLikeAComment
|
||||
""".trimIndent(),
|
||||
)
|
||||
|
||||
val entry = RepoMapIndexer().index(root).single()
|
||||
|
||||
assertFalse(entry.descriptor.contains("class ALongEnough"), entry.descriptor)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `extracts GDScript top-level symbols`(@TempDir root: Path) {
|
||||
root.resolve("player.gd").writeText(
|
||||
|
||||
@@ -0,0 +1,284 @@
|
||||
package com.correx.apps.server.ws
|
||||
|
||||
import com.correx.apps.server.ServerModule
|
||||
import com.correx.apps.server.configureServer
|
||||
import com.correx.apps.server.protocol.ServerMessage
|
||||
import com.correx.apps.server.registry.ProviderRegistry
|
||||
import com.correx.apps.server.registry.WorkflowRegistry
|
||||
import com.correx.apps.server.registry.WorkflowSummary
|
||||
import com.correx.apps.server.undo.SessionUndoService
|
||||
import com.correx.core.approvals.Tier
|
||||
import com.correx.core.artifactstore.ArtifactStore
|
||||
import com.correx.core.events.events.ApprovalRequestedEvent
|
||||
import com.correx.core.kernel.orchestration.DefaultOrchestrationReducer
|
||||
import com.correx.core.events.types.ArtifactId
|
||||
import com.correx.core.events.types.ProviderId
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.events.types.StageId
|
||||
import com.correx.core.events.types.ValidationReportId
|
||||
import com.correx.core.inference.DefaultInferenceRouter
|
||||
import com.correx.core.inference.InferenceProvider
|
||||
import com.correx.core.inference.ProviderHealth
|
||||
import com.correx.core.kernel.orchestration.DefaultSessionOrchestrator
|
||||
import com.correx.core.kernel.orchestration.OrchestrationConfig
|
||||
import com.correx.core.kernel.orchestration.OrchestrationProjector
|
||||
import com.correx.core.kernel.orchestration.OrchestratorEngines
|
||||
import com.correx.core.kernel.orchestration.OrchestratorRepositories
|
||||
import com.correx.core.kernel.retry.DefaultRetryCoordinator
|
||||
import com.correx.core.sessions.DefaultSessionReducer
|
||||
import com.correx.core.sessions.DefaultSessionRepository
|
||||
import com.correx.core.sessions.SessionProjector
|
||||
import com.correx.core.sessions.projections.replay.DefaultEventReplayer
|
||||
import com.correx.core.transitions.graph.StageConfig
|
||||
import com.correx.core.transitions.graph.WorkflowGraph
|
||||
import com.correx.infrastructure.InfrastructureModule
|
||||
import com.correx.infrastructure.inference.FirstAvailableRoutingStrategy
|
||||
import com.correx.infrastructure.inference.commons.UnavailableProbe
|
||||
import com.correx.infrastructure.persistence.InMemoryEventStore
|
||||
import com.correx.core.kernel.orchestration.OrchestrationRepository
|
||||
import io.ktor.client.plugins.websocket.WebSockets
|
||||
import io.ktor.client.plugins.websocket.webSocket
|
||||
import io.ktor.server.testing.testApplication
|
||||
import io.ktor.websocket.Frame
|
||||
import io.ktor.websocket.readText
|
||||
import kotlinx.coroutines.delay
|
||||
import kotlinx.coroutines.withTimeout
|
||||
import kotlinx.serialization.decodeFromString
|
||||
import kotlinx.serialization.json.Json
|
||||
import org.junit.jupiter.api.Assertions.assertNotNull
|
||||
import org.junit.jupiter.api.Assertions.assertTrue
|
||||
import org.junit.jupiter.api.Test
|
||||
import org.junit.jupiter.api.io.TempDir
|
||||
import java.nio.file.Path
|
||||
|
||||
/**
|
||||
* Covers task #190: a per-session `/sessions/{id}/stream` WS client must observe events that
|
||||
* fire *after* connect (e.g. ApprovalRequired for headless CLI --auto-approve), not just the
|
||||
* replay-on-connect snapshot. Also covers cleanup on disconnect.
|
||||
*/
|
||||
class SessionStreamHandlerTest {
|
||||
|
||||
private val protocolJson = Json { classDiscriminator = "type"; ignoreUnknownKeys = true }
|
||||
private fun decode(text: String): ServerMessage = protocolJson.decodeFromString(text)
|
||||
|
||||
private val noopArtifactStore: ArtifactStore = object : ArtifactStore {
|
||||
override suspend fun put(bytes: ByteArray): ArtifactId = ArtifactId("noop")
|
||||
override suspend fun get(id: ArtifactId): ByteArray? = null
|
||||
override suspend fun flushBefore(commit: suspend () -> Unit) = commit()
|
||||
}
|
||||
|
||||
private val noopProviderRegistry: ProviderRegistry = object : ProviderRegistry {
|
||||
override fun listAll() = emptyList<InferenceProvider>()
|
||||
override suspend fun healthCheckAll() = emptyMap<ProviderId, ProviderHealth>()
|
||||
}
|
||||
|
||||
private fun buildWorkflowRegistry(graph: WorkflowGraph): WorkflowRegistry = object : WorkflowRegistry {
|
||||
override fun listAll() = listOf(WorkflowSummary(graph.id, description = ""))
|
||||
override fun find(workflowId: String) = if (workflowId == graph.id) graph else null
|
||||
}
|
||||
|
||||
private fun minimalGraph(): WorkflowGraph = WorkflowGraph(
|
||||
id = "session-stream-test-workflow",
|
||||
stages = mapOf(StageId("s1") to StageConfig(allowedTools = emptySet())),
|
||||
transitions = emptySet(),
|
||||
start = StageId("s1"),
|
||||
)
|
||||
|
||||
private fun buildModule(tempDir: Path): ServerModule {
|
||||
val eventStore = InMemoryEventStore()
|
||||
val provider = InfrastructureModule.createLlamaCppProvider(
|
||||
modelId = "test-model",
|
||||
modelPath = "/dev/null",
|
||||
baseUrl = "http://127.0.0.1:1",
|
||||
)
|
||||
val infraRegistry = InfrastructureModule.createProviderRegistry(listOf(provider))
|
||||
val inferenceRouter = DefaultInferenceRouter(infraRegistry, FirstAvailableRoutingStrategy())
|
||||
|
||||
val toolConfig = com.correx.infrastructure.tools.ToolConfig(
|
||||
shell = com.correx.infrastructure.tools.ShellConfig(
|
||||
enabled = false, allowedExecutables = emptySet(), workingDir = tempDir,
|
||||
),
|
||||
fileRead = com.correx.infrastructure.tools.FileReadConfig(
|
||||
enabled = false, allowedPaths = setOf(tempDir),
|
||||
),
|
||||
fileWrite = com.correx.infrastructure.tools.FileWriteConfig(
|
||||
enabled = false, allowedPaths = setOf(tempDir), workingDir = tempDir,
|
||||
),
|
||||
fileEdit = com.correx.infrastructure.tools.FileEditConfig(
|
||||
enabled = false, allowedPaths = setOf(tempDir), workingDir = tempDir,
|
||||
),
|
||||
)
|
||||
val toolRegistry = InfrastructureModule.createToolRegistry(toolConfig)
|
||||
val eventDispatcher = com.correx.core.events.EventDispatcher(eventStore)
|
||||
val toolExecutor = InfrastructureModule.createToolExecutor(
|
||||
registry = toolRegistry,
|
||||
eventDispatcher = eventDispatcher,
|
||||
workDir = tempDir,
|
||||
artifactStore = null,
|
||||
)
|
||||
|
||||
val engines = OrchestratorEngines(
|
||||
transitionResolver = com.correx.core.transitions.resolution.DefaultTransitionResolver {
|
||||
condition, ctx -> condition.evaluate(ctx)
|
||||
},
|
||||
contextPackBuilder = com.correx.core.context.builder.DefaultContextPackBuilder(
|
||||
com.correx.core.context.compression.DefaultContextCompressor(),
|
||||
),
|
||||
inferenceRouter = inferenceRouter,
|
||||
validationPipeline = com.correx.core.validation.pipeline.ValidationPipeline(validators = emptyList()),
|
||||
approvalEngine = com.correx.core.approvals.domain.DefaultApprovalEngine(),
|
||||
riskAssessor = com.correx.core.risk.DefaultRiskAssessor(),
|
||||
toolRegistry = toolRegistry,
|
||||
toolExecutor = toolExecutor,
|
||||
)
|
||||
|
||||
val repositories = OrchestratorRepositories(
|
||||
eventStore = eventStore,
|
||||
inferenceRepository = com.correx.core.inference.InferenceRepository(
|
||||
DefaultEventReplayer(eventStore, com.correx.core.inference.InferenceProjector()),
|
||||
),
|
||||
orchestrationRepository = OrchestrationRepository(
|
||||
DefaultEventReplayer(eventStore, OrchestrationProjector(DefaultOrchestrationReducer())),
|
||||
),
|
||||
sessionRepository = DefaultSessionRepository(
|
||||
DefaultEventReplayer(eventStore, SessionProjector(DefaultSessionReducer())),
|
||||
),
|
||||
artifactRepository = InfrastructureModule.createArtifactRepository(eventStore),
|
||||
approvalRepository = InfrastructureModule.createApprovalRepository(eventStore),
|
||||
)
|
||||
|
||||
val orchestrator = DefaultSessionOrchestrator(
|
||||
repositories = repositories,
|
||||
engines = engines,
|
||||
retryCoordinator = DefaultRetryCoordinator(eventStore),
|
||||
artifactStore = noopArtifactStore,
|
||||
tokenizer = provider.tokenizer,
|
||||
decisionJournalRepository = InfrastructureModule.createDecisionJournalRepository(eventStore),
|
||||
)
|
||||
|
||||
val routerFacade = InfrastructureModule.createTalkieFacade(
|
||||
eventStore = eventStore,
|
||||
inferenceRouter = inferenceRouter,
|
||||
config = com.correx.core.talkie.model.TalkieConfig(),
|
||||
tokenizer = provider.tokenizer,
|
||||
)
|
||||
|
||||
val sessionUndoService = SessionUndoService(
|
||||
eventStore = eventStore,
|
||||
artifactStore = noopArtifactStore,
|
||||
bootRoots = setOf(tempDir),
|
||||
)
|
||||
|
||||
return ServerModule(
|
||||
orchestrator = orchestrator,
|
||||
eventStore = eventStore,
|
||||
artifactStore = noopArtifactStore,
|
||||
sessionRepository = repositories.sessionRepository,
|
||||
workflowRegistry = buildWorkflowRegistry(minimalGraph()),
|
||||
providerRegistry = noopProviderRegistry,
|
||||
defaultOrchestrationConfig = OrchestrationConfig(sandboxRoot = tempDir),
|
||||
routerFacade = routerFacade,
|
||||
orchestrationRepository = repositories.orchestrationRepository,
|
||||
approvalRepository = repositories.approvalRepository,
|
||||
toolRegistry = toolRegistry,
|
||||
sessionUndoService = sessionUndoService,
|
||||
resourceProbe = UnavailableProbe,
|
||||
)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `ApprovalRequired fired after connect reaches the session stream socket`(@TempDir tempDir: Path) {
|
||||
val module = buildModule(tempDir)
|
||||
module.start()
|
||||
val sessionId = SessionId("sid-190")
|
||||
|
||||
testApplication {
|
||||
application { configureServer(module) }
|
||||
val client = createClient { install(WebSockets) }
|
||||
|
||||
client.webSocket("/sessions/${sessionId.value}/stream") {
|
||||
// No lastEventId query param -> no replay, just registerClient() then the read loop.
|
||||
delay(100)
|
||||
|
||||
// Fire an ApprovalRequestedEvent through the *same* live fan-out ServerModule.start()
|
||||
// wires up (subscribeAll -> approvalCoordinator.onApprovalRequested -> broadcast()),
|
||||
// i.e. exactly what a gate firing mid-session would do post-connect.
|
||||
module.approvalCoordinator.onApprovalRequested(
|
||||
ApprovalRequestedEvent(
|
||||
requestId = com.correx.core.events.types.ApprovalRequestId("req-190"),
|
||||
tier = Tier.T2,
|
||||
validationReportId = ValidationReportId("vr-190"),
|
||||
riskSummaryId = null,
|
||||
sessionId = sessionId,
|
||||
stageId = null,
|
||||
projectId = null,
|
||||
),
|
||||
)
|
||||
|
||||
val frame = withTimeout(3_000L) {
|
||||
var text: String? = null
|
||||
while (text == null) {
|
||||
val f = incoming.receive()
|
||||
if (f is Frame.Text) text = f.readText()
|
||||
}
|
||||
text
|
||||
}
|
||||
val decoded = decode(frame)
|
||||
assertNotNull(decoded)
|
||||
assertTrue(decoded is ServerMessage.ApprovalRequired, "expected ApprovalRequired, got $decoded")
|
||||
assertTrue((decoded as ServerMessage.ApprovalRequired).requestId.value == "req-190")
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `disconnected socket does not block a broadcast to a later-connected sibling`(@TempDir tempDir: Path) {
|
||||
// Proves the SessionStreamHandler.handle() finally block actually deregisters the closed
|
||||
// socket from ApprovalCoordinator (3559ea67-style cleanup): with two clients on the same
|
||||
// session, closing the first and then firing an approval must still deliver cleanly to the
|
||||
// second - a stale/dead entry left in sessionClients would surface as a delivery failure
|
||||
// log (8d7c827e path) but must never throw or stall the broadcast.
|
||||
val module = buildModule(tempDir)
|
||||
module.start()
|
||||
val sessionId = SessionId("sid-190-disconnect")
|
||||
|
||||
testApplication {
|
||||
application { configureServer(module) }
|
||||
val client = createClient { install(WebSockets) }
|
||||
|
||||
client.webSocket("/sessions/${sessionId.value}/stream") {
|
||||
delay(100)
|
||||
}
|
||||
// First socket closed on exiting the block; its `finally { unregisterClient(...) }` runs.
|
||||
delay(200)
|
||||
|
||||
client.webSocket("/sessions/${sessionId.value}/stream") {
|
||||
delay(100)
|
||||
|
||||
module.approvalCoordinator.onApprovalRequested(
|
||||
ApprovalRequestedEvent(
|
||||
requestId = com.correx.core.events.types.ApprovalRequestId("req-190-b"),
|
||||
tier = Tier.T2,
|
||||
validationReportId = ValidationReportId("vr-190-b"),
|
||||
riskSummaryId = null,
|
||||
sessionId = sessionId,
|
||||
stageId = null,
|
||||
projectId = null,
|
||||
),
|
||||
)
|
||||
|
||||
val frame = withTimeout(3_000L) {
|
||||
var text: String? = null
|
||||
while (text == null) {
|
||||
val f = incoming.receive()
|
||||
if (f is Frame.Text) text = f.readText()
|
||||
}
|
||||
text
|
||||
}
|
||||
val decoded = decode(frame)
|
||||
assertTrue(decoded is ServerMessage.ApprovalRequired)
|
||||
assertTrue((decoded as ServerMessage.ApprovalRequired).requestId.value == "req-190-b")
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
@@ -23,6 +23,9 @@ CORREX kernel team. Config schema changes affect all consumers — coordinate wi
|
||||
- Config is read from disk; it is not event-sourced. Do not add event/state/reducer structures here.
|
||||
- `ConfigHolder` is the shared mutable reference injected into consumers. Never read the file directly in domain code — always go through `ConfigHolder`.
|
||||
- `CorrexConfigWriter` regenerates TOML from the in-memory model; round-tripping loses comments by design.
|
||||
- `[git]` is opt-in server transport configuration (`enabled`, `remote`, `base_branch`, optional `author`); it is off by default.
|
||||
- `[orchestration].review_loop_max_cycles` bounds review→rework cycles before recovery escalation; default `3`.
|
||||
- `ModelConfig.contextSize` defaults to 24,576 tokens; explicit `context_size` remains the operator override for smaller local-model windows.
|
||||
|
||||
## Verification
|
||||
|
||||
|
||||
@@ -199,7 +199,7 @@ object ConfigLoader {
|
||||
private const val DEFAULT_CONVERSATION_KEEP_LAST = 6
|
||||
private const val DEFAULT_RETRIEVAL_K = 5
|
||||
private const val DEFAULT_TOKEN_BUDGET = 4096
|
||||
private const val DEFAULT_MODEL_CONTEXT_SIZE = 8192
|
||||
private const val DEFAULT_MODEL_CONTEXT_SIZE = 24_576
|
||||
private const val DEFAULT_PROJECT_MEMORY_K = 5
|
||||
private const val DEFAULT_PROJECT_MAX_DEPTH = 4
|
||||
private const val DEFAULT_PROJECT_INJECT_TOP_K = 30
|
||||
@@ -217,6 +217,7 @@ object ConfigLoader {
|
||||
private const val DEFAULT_MAX_CLARIFICATION_ROUNDS = 3
|
||||
private const val DEFAULT_REVIEW_BLOCK_MIN_CONFIDENCE = 0.7
|
||||
private const val DEFAULT_REVIEW_BLOCK_RETRY_CAP = 20
|
||||
private const val DEFAULT_REVIEW_LOOP_MAX_CYCLES = 3
|
||||
private const val DEFAULT_MAX_REFINEMENT = 3
|
||||
private const val DEFAULT_RECOVERY_ROUTE_BUDGET = 2
|
||||
private const val DEFAULT_INTENT_ROUTE_BUDGET = 2
|
||||
@@ -265,9 +266,11 @@ object ConfigLoader {
|
||||
val providers = mutableListOf<MutableMap<String, Any>>()
|
||||
val models = mutableListOf<MutableMap<String, Any>>()
|
||||
val artifacts = mutableListOf<MutableMap<String, Any>>()
|
||||
val mcpServers = mutableListOf<MutableMap<String, Any>>()
|
||||
var currentProvider: MutableMap<String, Any>? = null
|
||||
var currentModel: MutableMap<String, Any>? = null
|
||||
var currentArtifact: MutableMap<String, Any>? = null
|
||||
var currentMcp: MutableMap<String, Any>? = null
|
||||
|
||||
// Flush any open array-of-table entry into its list. Called whenever a new
|
||||
// table header (array or section) starts, so the previous entry is committed.
|
||||
@@ -275,9 +278,11 @@ object ConfigLoader {
|
||||
currentProvider?.let { providers.add(it) }
|
||||
currentModel?.let { models.add(it) }
|
||||
currentArtifact?.let { artifacts.add(it) }
|
||||
currentMcp?.let { mcpServers.add(it) }
|
||||
currentProvider = null
|
||||
currentModel = null
|
||||
currentArtifact = null
|
||||
currentMcp = null
|
||||
}
|
||||
|
||||
for ((lineNum, line) in lines.withIndex()) {
|
||||
@@ -302,6 +307,11 @@ object ConfigLoader {
|
||||
currentArtifact = mutableMapOf()
|
||||
currentSection = ""
|
||||
}
|
||||
trimmed == "[[mcp]]" -> {
|
||||
flushTables()
|
||||
currentMcp = mutableMapOf()
|
||||
currentSection = ""
|
||||
}
|
||||
trimmed.startsWith("[") && !trimmed.startsWith("[[") && trimmed.endsWith("]") -> {
|
||||
// Parse section headers like [server] or [tools.shell]
|
||||
flushTables()
|
||||
@@ -320,10 +330,12 @@ object ConfigLoader {
|
||||
val provider = currentProvider
|
||||
val model = currentModel
|
||||
val artifact = currentArtifact
|
||||
val mcp = currentMcp
|
||||
when {
|
||||
provider != null -> provider[key] = parsedValue
|
||||
model != null -> model[key] = parsedValue
|
||||
artifact != null -> artifact[key] = parsedValue
|
||||
mcp != null -> mcp[key] = parsedValue
|
||||
currentSection.isNotEmpty() -> sections[currentSection]?.put(key, parsedValue)
|
||||
}
|
||||
}
|
||||
@@ -334,7 +346,7 @@ object ConfigLoader {
|
||||
// Don't forget the last array-of-table entry if file ends with one
|
||||
flushTables()
|
||||
|
||||
return buildConfig(sections, providers, models, artifacts)
|
||||
return buildConfig(sections, providers, models, artifacts, mcpServers)
|
||||
}
|
||||
|
||||
private fun parseValue(valueStr: String, lineNum: Int): Any {
|
||||
@@ -452,6 +464,7 @@ object ConfigLoader {
|
||||
providersList: List<Map<String, Any>> = emptyList(),
|
||||
modelsList: List<Map<String, Any>> = emptyList(),
|
||||
artifactsList: List<Map<String, Any>> = emptyList(),
|
||||
mcpList: List<Map<String, Any>> = emptyList(),
|
||||
): CorrexConfig {
|
||||
val serverSection = sections["server"] ?: emptyMap()
|
||||
val tuiSection = sections["tui"] ?: emptyMap()
|
||||
@@ -704,6 +717,8 @@ object ConfigLoader {
|
||||
reviewBlockMinConfidence =
|
||||
asDouble(orchestrationSection["review_block_min_confidence"], DEFAULT_REVIEW_BLOCK_MIN_CONFIDENCE),
|
||||
reviewBlockRetryCap = asInt(orchestrationSection["review_block_retry_cap"], DEFAULT_REVIEW_BLOCK_RETRY_CAP),
|
||||
reviewLoopMaxCycles =
|
||||
asInt(orchestrationSection["review_loop_max_cycles"], DEFAULT_REVIEW_LOOP_MAX_CYCLES),
|
||||
defaultMaxRefinement = asInt(orchestrationSection["default_max_refinement"], DEFAULT_MAX_REFINEMENT),
|
||||
recoveryRouteBudget = asInt(orchestrationSection["recovery_route_budget"], DEFAULT_RECOVERY_ROUTE_BUDGET),
|
||||
intentRouteBudget = asInt(orchestrationSection["intent_route_budget"], DEFAULT_INTENT_ROUTE_BUDGET),
|
||||
@@ -735,6 +750,28 @@ object ConfigLoader {
|
||||
repeatPenalty = samplingSection["repeat_penalty"]?.let { asDouble(it) },
|
||||
)
|
||||
|
||||
val mcp = mcpList.mapNotNull { mcpMap ->
|
||||
val id = asStringOrNull(mcpMap["id"]) ?: return@mapNotNull null
|
||||
val command = asStringList(mcpMap["command"])
|
||||
if (command.isEmpty()) return@mapNotNull null
|
||||
@Suppress("UNCHECKED_CAST")
|
||||
val env = (mcpMap["env"] as? Map<String, Any>)?.mapValues { it.value.toString() } ?: emptyMap()
|
||||
McpServerConfig(
|
||||
id = id,
|
||||
command = command,
|
||||
env = env,
|
||||
tier = asString(mcpMap["tier"], "T2"),
|
||||
)
|
||||
}
|
||||
|
||||
val gitSection = sections["git"] ?: emptyMap()
|
||||
val git = GitConfig(
|
||||
enabled = asBoolean(gitSection["enabled"], false),
|
||||
remote = asString(gitSection["remote"], "origin"),
|
||||
baseBranch = asString(gitSection["base_branch"], "main"),
|
||||
author = asString(gitSection["author"], ""),
|
||||
)
|
||||
|
||||
return CorrexConfig(
|
||||
server = server,
|
||||
tui = tui,
|
||||
@@ -749,6 +786,8 @@ object ConfigLoader {
|
||||
personalization = personalization,
|
||||
orchestration = orchestration,
|
||||
sampling = sampling,
|
||||
git = git,
|
||||
mcp = mcp,
|
||||
)
|
||||
}
|
||||
|
||||
|
||||
@@ -18,6 +18,34 @@ data class CorrexConfig(
|
||||
val orchestration: OrchestrationKnobs = OrchestrationKnobs(),
|
||||
val sampling: SamplingConfig = SamplingConfig(),
|
||||
val health: HealthConfig = HealthConfig(),
|
||||
val git: GitConfig = GitConfig(),
|
||||
val mcp: List<McpServerConfig> = emptyList(),
|
||||
)
|
||||
|
||||
/**
|
||||
* An MCP server to mount at startup. Its `tools/list` becomes Correx tools (`mcp__<id>__<name>`),
|
||||
* gated at [tier] (default T2 = approval) since an external tool's side effects are opaque.
|
||||
*/
|
||||
@Serializable
|
||||
data class McpServerConfig(
|
||||
val id: String,
|
||||
val command: List<String>,
|
||||
val env: Map<String, String> = emptyMap(),
|
||||
val tier: String = "T2",
|
||||
)
|
||||
|
||||
/**
|
||||
* Optional transport for a server-owned checkout. Each run executes on a `run/<sessionId>` branch
|
||||
* based on [baseBranch] and pushes that branch on terminal completion; the working directory stays
|
||||
* a real local path, never a remote URL or mounted client filesystem.
|
||||
*/
|
||||
@Serializable
|
||||
data class GitConfig(
|
||||
val enabled: Boolean = false,
|
||||
val remote: String = "origin",
|
||||
val baseBranch: String = "main",
|
||||
/** Optional Git author value, for example `Correx <correx@example.invalid>`. */
|
||||
val author: String = "",
|
||||
)
|
||||
|
||||
/**
|
||||
@@ -102,6 +130,8 @@ data class OrchestrationKnobs(
|
||||
val maxClarificationRounds: Int = 3,
|
||||
val reviewBlockMinConfidence: Double = 0.7,
|
||||
val reviewBlockRetryCap: Int = 20,
|
||||
/** Review→rework cycles before deterministic escalation to the recovery stage. */
|
||||
val reviewLoopMaxCycles: Int = 3,
|
||||
val defaultMaxRefinement: Int = 3,
|
||||
val recoveryRouteBudget: Int = 2,
|
||||
val intentRouteBudget: Int = 2,
|
||||
@@ -283,7 +313,8 @@ data class L3Config(
|
||||
data class ModelConfig(
|
||||
val id: String,
|
||||
val modelPath: String,
|
||||
val contextSize: Int = 8192,
|
||||
/** Default window for implementation stages; leave headroom above their 24K prompt budget. */
|
||||
val contextSize: Int = 24_576,
|
||||
val params: Map<String, String> = emptyMap(),
|
||||
val capabilities: Map<String, Double> = emptyMap(),
|
||||
)
|
||||
|
||||
@@ -98,6 +98,7 @@ object CorrexConfigWriter {
|
||||
b.kv("max_clarification_rounds", cfg.orchestration.maxClarificationRounds)
|
||||
b.kv("review_block_min_confidence", cfg.orchestration.reviewBlockMinConfidence)
|
||||
b.kv("review_block_retry_cap", cfg.orchestration.reviewBlockRetryCap)
|
||||
b.kv("review_loop_max_cycles", cfg.orchestration.reviewLoopMaxCycles)
|
||||
b.kv("default_max_refinement", cfg.orchestration.defaultMaxRefinement)
|
||||
b.kv("recovery_route_budget", cfg.orchestration.recoveryRouteBudget)
|
||||
b.kv("intent_route_budget", cfg.orchestration.intentRouteBudget)
|
||||
@@ -109,6 +110,12 @@ object CorrexConfigWriter {
|
||||
cfg.sampling.minP?.let { b.kv("min_p", it) }
|
||||
cfg.sampling.repeatPenalty?.let { b.kv("repeat_penalty", it) }
|
||||
|
||||
b.section("git")
|
||||
b.kv("enabled", cfg.git.enabled)
|
||||
b.kv("remote", str(cfg.git.remote))
|
||||
b.kv("base_branch", str(cfg.git.baseBranch))
|
||||
b.kv("author", str(cfg.git.author))
|
||||
|
||||
b.section("personalization")
|
||||
b.kv("enabled", cfg.personalization.enabled)
|
||||
b.kv("learn", cfg.personalization.learn)
|
||||
|
||||
@@ -390,6 +390,31 @@ class ConfigLoaderTest {
|
||||
assertEquals(10001, result.modelsSettings.port)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `parseToml parses mcp array-of-tables with command list and env`() {
|
||||
val toml = """
|
||||
[[mcp]]
|
||||
id = "codebase-memory"
|
||||
command = ["codebase-memory-mcp", "serve"]
|
||||
env = { RUST_LOG = "info" }
|
||||
|
||||
[[mcp]]
|
||||
id = "other"
|
||||
command = ["other-server"]
|
||||
""".trimIndent()
|
||||
|
||||
val parseTomlMethod = ConfigLoader::class.java.getDeclaredMethod("parseToml", String::class.java)
|
||||
parseTomlMethod.isAccessible = true
|
||||
val result = parseTomlMethod.invoke(ConfigLoader, toml) as CorrexConfig
|
||||
|
||||
assertEquals(2, result.mcp.size)
|
||||
assertEquals("codebase-memory", result.mcp[0].id)
|
||||
assertEquals(listOf("codebase-memory-mcp", "serve"), result.mcp[0].command)
|
||||
assertEquals("info", result.mcp[0].env["RUST_LOG"])
|
||||
assertEquals("T2", result.mcp[0].tier)
|
||||
assertEquals(listOf("other-server"), result.mcp[1].command)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `parseToml returns empty models list and default modelsSettings when sections absent`() {
|
||||
val toml = """
|
||||
@@ -434,7 +459,7 @@ class ConfigLoaderTest {
|
||||
assertEquals(1, result.models.size)
|
||||
assertEquals("local-model", result.models[0].id)
|
||||
assertEquals("/models/local.gguf", result.models[0].modelPath)
|
||||
assertEquals(8192, result.models[0].contextSize)
|
||||
assertEquals(24_576, result.models[0].contextSize)
|
||||
}
|
||||
|
||||
@Test
|
||||
|
||||
@@ -37,6 +37,7 @@ class CorrexConfigWriterTest {
|
||||
),
|
||||
personalization = PersonalizationConfig(enabled = true, learn = true),
|
||||
project = ProjectConfig(enabled = true, root = "/repo", memoryK = 8, maxDepth = 6, injectTopK = 40),
|
||||
git = GitConfig(enabled = true, remote = "gitea", baseBranch = "develop", author = "Correx <bot@example.test>"),
|
||||
modelsSettings = ModelsSettings(defaultModel = "m1", host = "0.0.0.0", port = 10001),
|
||||
orchestration = OrchestrationKnobs(stageTimeoutMs = 90_000, journalCompactionTokenThreshold = 12_000),
|
||||
providers = listOf(
|
||||
|
||||
@@ -20,6 +20,7 @@ CORREX kernel team. This is the most cross-cutting module in the codebase — ch
|
||||
- `JsonEventSerializer` / `EventSerializer` — serialize/deserialize `StoredEvent` to JSON.
|
||||
- `EventDispatcher` — broadcasts events to in-process listeners.
|
||||
- Domain event files: `ApprovalEvents`, `ArtifactEvents`, `ContextEvents`, `InferenceEvents`, `OrchestrationEvents`, `RouterEvents`, `SessionEvents`, `TaskEvents`, `ToolEvents`, `IntentEvents`, `RiskAssessedEvent`, `JournalCompactedEvent`, and many more — all payload definitions live here.
|
||||
- `LspDiagnosticsCompletedEvent` records pulled language-server diagnostics or a graceful skip reason; replay consumes this observation and never contacts the server.
|
||||
- Shared vocabulary: `IdentityTypes` (SessionId, TaskId, etc.), `Tier`, `TokenUsage`, `ToolReceipt`, `ToolRequest`, `RiskLevel`, `RetryPolicy`, `GrantScope`, `GrantLedger`.
|
||||
|
||||
## Work Guidance
|
||||
@@ -27,6 +28,8 @@ CORREX kernel team. This is the most cross-cutting module in the codebase — ch
|
||||
- **SILENT FAILURE TRAP**: After adding any `EventPayload` subclass, immediately add it to `Serialization.kt` `eventModule` block. Run `./gradlew check` to verify. Tests may pass without it but runtime replay will fail silently.
|
||||
- `AnyMapSerializer` — custom serializer for `Map<String, Any?>`; use it for dynamic payloads, don't roll another.
|
||||
- Event classes are `@Serializable data class` with no mutable state. No methods beyond data accessors.
|
||||
- `RunBranchPushedEvent` records an optional server Git transport push only after it succeeds; its branch/base/head SHAs are observations, not values replay recalculates.
|
||||
- `RepoMapEntry.descriptor` is a bounded source-purpose observation recorded with the repo map and used when constructing semantic L3 embeddings.
|
||||
- Do not add domain logic to events. They are records, not actors.
|
||||
- `EgressAllowlistProjection` — special projection kept in this module because it is used by both `core:toolintent` and `core:events` consumers; it is a shared cross-cutting projection.
|
||||
|
||||
|
||||
@@ -0,0 +1,42 @@
|
||||
package com.correx.core.events.events
|
||||
|
||||
import com.correx.core.events.types.SessionId
|
||||
import kotlinx.serialization.SerialName
|
||||
import kotlinx.serialization.Serializable
|
||||
|
||||
/**
|
||||
* A validated failure→fix pattern the heuristic concept compiler has seen resolved reliably enough to
|
||||
* promote (design 2026-07-12-acr-concept-compiler.md). The only "write" the compiler makes: a
|
||||
* deterministic rule firing — a [fingerprint] whose validated-fix count crossed the promotion
|
||||
* threshold, never contradicted — so it needs no assessor gate (invariant #3/#7 hold trivially:
|
||||
* nothing model-proposed reaches state here).
|
||||
*
|
||||
* Read-only over the log otherwise: the promotion is derivable from the RetryAttempted→StageCompleted
|
||||
* stream, and this event makes the promotion idempotent under replay (the compiler folds already-emitted
|
||||
* fingerprints into its promoted set and never re-promotes). Best-effort injected into L3 as a
|
||||
* retrieval-on-demand concept; the L3 write is non-authoritative (invariant #6) — this event is truth.
|
||||
*/
|
||||
@Serializable
|
||||
@SerialName("ConceptPromoted")
|
||||
data class ConceptPromotedEvent(
|
||||
// A dedicated system session (ConceptCompilerService.SYSTEM_SESSION) — concepts are cross-session,
|
||||
// so they live on their own stream rather than polluting any user session's replay.
|
||||
val sessionId: SessionId,
|
||||
// Gate-agnostic fingerprint of the recurring failure (see FailureFingerprint) — the last-seen
|
||||
// instance, used as the L3 instance-recall id.
|
||||
val fingerprint: String,
|
||||
// Reusable class key `gate + normalized(signature)` the concept is promoted on (design §"class key").
|
||||
// Defaulted for back-compat with v1 events that predate class-key promotion.
|
||||
val classKey: String = "",
|
||||
// The gate the failure recurred on ("contract" | "review" | "plan-compile" | "lint" | "static" | …).
|
||||
val gate: String,
|
||||
// Templated, retrieval-friendly concept text injected into L3.
|
||||
val conceptText: String,
|
||||
// Count of validated fixes observed at promotion time (≥ threshold).
|
||||
val occurrences: Int,
|
||||
// Reference to the validated fix: the CAS path + post-image hash of the file the resolving stage
|
||||
// wrote to clear this failure (design 2026-07-12-acr-concept-compiler.md §"carry the fix").
|
||||
// Null when no file write was observed between the retry and the completion. Additive/back-compat.
|
||||
val fixPath: String? = null,
|
||||
val fixHash: String? = null,
|
||||
) : EventPayload
|
||||
@@ -16,6 +16,8 @@ data class ContractAssertionResult(
|
||||
/** Evaluator that produced the verdict: FS / TEXT / COMPILER / AST. */
|
||||
val evaluator: String,
|
||||
val passed: Boolean,
|
||||
/** True when this assertion is intentionally deferred to another authoritative gate. */
|
||||
val skipped: Boolean = false,
|
||||
/** Concrete reason the assertion failed (or a confirmation when it passed). Kept bounded. */
|
||||
val evidence: String,
|
||||
)
|
||||
|
||||
@@ -74,6 +74,34 @@ data class CapabilityGapDetectedEvent(
|
||||
val timestampMs: Long,
|
||||
) : EventPayload
|
||||
|
||||
/** Verdict of the deterministic plan-grounding phase (design 2026-07-15 seam 1). */
|
||||
enum class PlanGroundingVerdict { PASS, RETURN_TO_ARCHITECT, CLARIFICATION_REQUIRED }
|
||||
|
||||
/**
|
||||
* The compiled plan was evaluated against recorded workspace facts BEFORE lock (design 2026-07-15
|
||||
* §"Seam 1: plan grounding before lock"). Deterministic, pure over the plan graph plus the session's
|
||||
* recorded [RepoMapComputedEvent] and [ProjectProfileBoundEvent] — no inference, no live FS read, so
|
||||
* replay reads the recorded verdict back (invariants #8/#9). A non-[PlanGroundingVerdict.PASS] verdict
|
||||
* blocks the lock and returns compact [findings] to the architect, so a doomed scaffold fails at stage
|
||||
* 0 rather than after downstream files accumulate.
|
||||
*
|
||||
* v1 grounds build prerequisites: a stage that will run a build/typecheck/test command against a
|
||||
* prerequisite (build manifest) that neither exists in the recorded repo map nor is produced by any
|
||||
* plan stage is ungrounded. Path/symbol-reference grounding (spec rows 2/3) needs a grounding-grade
|
||||
* symbol index and is deferred — those assumptions resolve to `unknown`, never `present`.
|
||||
*
|
||||
* [stateKey] pins the workspace snapshot (repo-map hash) the grounding was evaluated against.
|
||||
*/
|
||||
@Serializable
|
||||
@SerialName("PlanGroundingEvaluated")
|
||||
data class PlanGroundingEvaluatedEvent(
|
||||
val sessionId: SessionId,
|
||||
val planId: String,
|
||||
val stateKey: String,
|
||||
val verdict: PlanGroundingVerdict,
|
||||
val findings: List<String> = emptyList(),
|
||||
) : EventPayload
|
||||
|
||||
/** Outcome of the bounded LLM "are you sure?" reflection pass over a [CapabilityGapDetectedEvent]. */
|
||||
enum class CapabilityGapVerdict { RESOLVED, NEEDS_TOOL }
|
||||
|
||||
|
||||
@@ -0,0 +1,27 @@
|
||||
package com.correx.core.events.events
|
||||
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.events.types.StageId
|
||||
import kotlinx.serialization.SerialName
|
||||
import kotlinx.serialization.Serializable
|
||||
|
||||
@Serializable
|
||||
data class LspDiagnostic(
|
||||
val path: String,
|
||||
val line: Int,
|
||||
val character: Int,
|
||||
val severity: String,
|
||||
val code: String? = null,
|
||||
val message: String,
|
||||
)
|
||||
|
||||
/** Recorded LSP 3.17 pull-diagnostic observation; replay never re-queries a language server. */
|
||||
@Serializable
|
||||
@SerialName("LspDiagnosticsCompleted")
|
||||
data class LspDiagnosticsCompletedEvent(
|
||||
val sessionId: SessionId,
|
||||
val stageId: StageId,
|
||||
val server: String?,
|
||||
val diagnostics: List<LspDiagnostic>,
|
||||
val skippedReason: String? = null,
|
||||
) : EventPayload
|
||||
@@ -36,6 +36,19 @@ data class WorkflowFailedEvent(
|
||||
val retryExhausted: Boolean,
|
||||
) : EventPayload
|
||||
|
||||
/**
|
||||
* Observation recorded only after the optional server Git transport has pushed a terminal run
|
||||
* branch. This keeps the reviewable branch reference replayable without re-running Git.
|
||||
*/
|
||||
@Serializable
|
||||
@SerialName("RunBranchPushed")
|
||||
data class RunBranchPushedEvent(
|
||||
val sessionId: SessionId,
|
||||
val branch: String,
|
||||
val baseSha: String,
|
||||
val headSha: String,
|
||||
) : EventPayload
|
||||
|
||||
/**
|
||||
* Records that the operator approved access to a specific path OUTSIDE the workspace root
|
||||
* (a `file_read`/`list_dir` target). The intent plane raises PROMPT_USER for any out-of-workspace
|
||||
@@ -155,3 +168,23 @@ data class RetrySalvageDecidedEvent(
|
||||
val decision: SalvageDecision,
|
||||
val rationale: String,
|
||||
) : EventPayload
|
||||
|
||||
/**
|
||||
* A stage repeatedly blocked on a missing build prerequisite (see repeatedBuildCriticalReferenceBlock,
|
||||
* design 2026-07-15 §#170) AND the stage both holds file_write and declares the path in-scope, so the
|
||||
* orchestrator grants it ONE dedicated bootstrap turn to create/repair that prerequisite — separately
|
||||
* budgeted, NOT charged against the normal stage retry counter. This marker records the grant: it caps
|
||||
* the bootstrap at one attempt per stage (a second block escalates to recovery) and scopes the
|
||||
* REFERENCE_EXISTS block window so historical blocks from before the grant don't re-trip the gate on
|
||||
* the fresh turn. Recorded (invariant #9) so replay reproduces the same bounded bootstrap.
|
||||
*/
|
||||
@Serializable
|
||||
@SerialName("BuildPrerequisiteBootstrapAttempted")
|
||||
data class BuildPrerequisiteBootstrapAttemptedEvent(
|
||||
val sessionId: SessionId,
|
||||
val stageId: StageId,
|
||||
// The build-critical workspace-relative path the stage is granted a turn to create/repair.
|
||||
val path: String,
|
||||
// The gate evidence (repeatedBuildCriticalReferenceBlock reason) that triggered the grant.
|
||||
val evidence: String,
|
||||
) : EventPayload
|
||||
|
||||
@@ -11,6 +11,8 @@ data class RepoMapEntry(
|
||||
val path: String,
|
||||
val score: Double,
|
||||
val symbols: List<String> = emptyList(),
|
||||
/** Bounded deterministic source-purpose text used for semantic repo retrieval. */
|
||||
val descriptor: String = "",
|
||||
)
|
||||
|
||||
/**
|
||||
|
||||
+32
@@ -0,0 +1,32 @@
|
||||
package com.correx.core.events.events
|
||||
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.events.types.StageId
|
||||
import kotlinx.serialization.SerialName
|
||||
import kotlinx.serialization.Serializable
|
||||
|
||||
/**
|
||||
* The known-good workspace invariant (design 2026-07-15 §"Known-good workspace invariant", seam 2).
|
||||
* After a code/config-writing stage runs its deterministic build/test gate, the orchestrator records
|
||||
* ONE verification observation binding the [passed] result to the [stateKey] of the workspace that was
|
||||
* actually verified. The next implementation stage may treat the workspace as `known-good` only when
|
||||
* a passing observation's [stateKey] still equals the current recorded state key — a later write
|
||||
* changes the key, so a dirty workspace can never be mistaken for the state that passed.
|
||||
*
|
||||
* The [stateKey] is derived purely from the recorded FileWritten manifest (path → latest post-image
|
||||
* hash), so it is replay-safe: replay reads this event and the key back, never re-running [command]
|
||||
* or rescanning the filesystem (invariants #8/#9). [changedPaths] are the write-declaring stage's
|
||||
* paths at verification time; [expectation] is the deterministic build vocabulary (MODULE/PROJECT/
|
||||
* TESTS) that selected [command] — the model never chooses the truth test.
|
||||
*/
|
||||
@Serializable
|
||||
@SerialName("WorkspaceVerificationObserved")
|
||||
data class WorkspaceVerificationObservedEvent(
|
||||
val sessionId: SessionId,
|
||||
val stageId: StageId,
|
||||
val stateKey: String,
|
||||
val expectation: String,
|
||||
val command: String,
|
||||
val passed: Boolean,
|
||||
val changedPaths: List<String> = emptyList(),
|
||||
) : EventPayload
|
||||
@@ -14,7 +14,9 @@ import com.correx.core.events.events.ArtifactValidatedEvent
|
||||
import com.correx.core.events.events.ArtifactValidatingEvent
|
||||
import com.correx.core.events.events.BriefEchoMismatchEvent
|
||||
import com.correx.core.events.events.BriefGroundingCheckedEvent
|
||||
import com.correx.core.events.events.ConceptPromotedEvent
|
||||
import com.correx.core.events.events.StaticAnalysisCompletedEvent
|
||||
import com.correx.core.events.events.LspDiagnosticsCompletedEvent
|
||||
import com.correx.core.events.events.ContractGateEvaluatedEvent
|
||||
import com.correx.core.events.events.PlanLintCompletedEvent
|
||||
import com.correx.core.events.events.ChatSessionStartedEvent
|
||||
@@ -64,6 +66,9 @@ import com.correx.core.events.events.RepoMapComputedEvent
|
||||
import com.correx.core.events.events.RetryAttemptedEvent
|
||||
import com.correx.core.events.events.RetrySalvageDecidedEvent
|
||||
import com.correx.core.events.events.FailureTicketOpenedEvent
|
||||
import com.correx.core.events.events.BuildPrerequisiteBootstrapAttemptedEvent
|
||||
import com.correx.core.events.events.WorkspaceVerificationObservedEvent
|
||||
import com.correx.core.events.events.PlanGroundingEvaluatedEvent
|
||||
import com.correx.core.events.events.OutsidePathAccessGrantedEvent
|
||||
import com.correx.core.events.events.WorkspaceStateObservedEvent
|
||||
import com.correx.core.events.events.RiskAssessedEvent
|
||||
@@ -88,6 +93,7 @@ import com.correx.core.events.events.WorkflowCompletedEvent
|
||||
import com.correx.core.events.events.WorkflowFailedEvent
|
||||
import com.correx.core.events.events.WorkflowProposedEvent
|
||||
import com.correx.core.events.events.WorkflowStartedEvent
|
||||
import com.correx.core.events.events.RunBranchPushedEvent
|
||||
import com.correx.core.events.events.TaskCreatedEvent
|
||||
import com.correx.core.events.events.TaskClaimedEvent
|
||||
import com.correx.core.events.events.TaskReleasedEvent
|
||||
@@ -128,6 +134,7 @@ val eventModule = SerializersModule {
|
||||
subclass(SessionNamedEvent::class)
|
||||
subclass(StageFailedEvent::class)
|
||||
subclass(StageCompletedEvent::class)
|
||||
subclass(ConceptPromotedEvent::class)
|
||||
subclass(TransitionExecutedEvent::class)
|
||||
subclass(ApprovalRequestedEvent::class)
|
||||
subclass(ApprovalDecisionResolvedEvent::class)
|
||||
@@ -149,11 +156,15 @@ val eventModule = SerializersModule {
|
||||
subclass(OrchestrationResumedEvent::class)
|
||||
subclass(OrchestrationPausedEvent::class)
|
||||
subclass(WorkflowStartedEvent::class)
|
||||
subclass(RunBranchPushedEvent::class)
|
||||
subclass(WorkflowFailedEvent::class)
|
||||
subclass(WorkflowCompletedEvent::class)
|
||||
subclass(RetryAttemptedEvent::class)
|
||||
subclass(RetrySalvageDecidedEvent::class)
|
||||
subclass(FailureTicketOpenedEvent::class)
|
||||
subclass(BuildPrerequisiteBootstrapAttemptedEvent::class)
|
||||
subclass(WorkspaceVerificationObservedEvent::class)
|
||||
subclass(PlanGroundingEvaluatedEvent::class)
|
||||
subclass(OutsidePathAccessGrantedEvent::class)
|
||||
subclass(RefinementIterationEvent::class)
|
||||
subclass(RepoMapComputedEvent::class)
|
||||
@@ -163,6 +174,7 @@ val eventModule = SerializersModule {
|
||||
subclass(BriefGroundingCheckedEvent::class)
|
||||
subclass(BriefEchoMismatchEvent::class)
|
||||
subclass(StaticAnalysisCompletedEvent::class)
|
||||
subclass(LspDiagnosticsCompletedEvent::class)
|
||||
subclass(ContractGateEvaluatedEvent::class)
|
||||
subclass(PlanLintCompletedEvent::class)
|
||||
subclass(RiskAssessedEvent::class)
|
||||
|
||||
+27
@@ -0,0 +1,27 @@
|
||||
package com.correx.core.events.serialization
|
||||
|
||||
import com.correx.core.events.events.ConceptPromotedEvent
|
||||
import com.correx.core.events.events.EventPayload
|
||||
import com.correx.core.events.types.SessionId
|
||||
import kotlin.test.Test
|
||||
import kotlin.test.assertEquals
|
||||
import kotlin.test.assertTrue
|
||||
|
||||
class ConceptPromotedEventSerializationTest {
|
||||
|
||||
private val sample = ConceptPromotedEvent(
|
||||
sessionId = SessionId("__concept_compiler__"),
|
||||
fingerprint = "1a2b3c",
|
||||
gate = "lint",
|
||||
conceptText = "Recurring lint failure (validated-fixed 3x across sessions): detekt: MagicNumber.",
|
||||
occurrences = 3,
|
||||
)
|
||||
|
||||
@Test
|
||||
fun `round-trips as polymorphic EventPayload`() {
|
||||
val encoded = eventJson.encodeToString(EventPayload.serializer(), sample)
|
||||
assertTrue(encoded.contains("\"type\":\"ConceptPromoted\""), "SerialName must be present: $encoded")
|
||||
val decoded = eventJson.decodeFromString(EventPayload.serializer(), encoded)
|
||||
assertEquals(sample, decoded)
|
||||
}
|
||||
}
|
||||
+23
@@ -0,0 +1,23 @@
|
||||
package com.correx.core.events.serialization
|
||||
|
||||
import com.correx.core.events.events.LspDiagnostic
|
||||
import com.correx.core.events.events.LspDiagnosticsCompletedEvent
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.events.types.StageId
|
||||
import kotlin.test.Test
|
||||
import kotlin.test.assertEquals
|
||||
import kotlin.test.assertIs
|
||||
|
||||
class LspDiagnosticsCompletedEventSerializationTest {
|
||||
@Test
|
||||
fun `round-trips as polymorphic EventPayload`() {
|
||||
val event = LspDiagnosticsCompletedEvent(
|
||||
SessionId("s"), StageId("impl"), "tsserver",
|
||||
listOf(LspDiagnostic("src/App.tsx", 1, 2, "error", "2322", "not assignable")),
|
||||
)
|
||||
val encoded = eventJson.encodeToString(com.correx.core.events.events.EventPayload.serializer(), event)
|
||||
val decoded = eventJson.decodeFromString(com.correx.core.events.events.EventPayload.serializer(), encoded)
|
||||
assertIs<LspDiagnosticsCompletedEvent>(decoded)
|
||||
assertEquals("src/App.tsx", decoded.diagnostics.single().path)
|
||||
}
|
||||
}
|
||||
@@ -19,7 +19,12 @@ CORREX kernel team. This is the integration point for all other `core/` modules.
|
||||
- `ReplayOrchestrator` / `ReplayInferenceProvider` / `ReplayStrategy` — deterministic replay of a session from its event log. `ReplayInferenceProvider` returns recorded responses — no live LLM (Hard Invariant #8).
|
||||
- `SubagentRunner` / `InSessionSubagentRunner` — runs sub-agent invocations within an active session.
|
||||
- `StaticAnalysisRunner` / `ProcessStaticAnalysisRunner` — runs static analysis tools and records results as events.
|
||||
- `LspDiagnosticsRunner` — injected pull-diagnostics seam; diagnostics are filtered to stage-written files, recorded, and enforced before build/review.
|
||||
- Review→rework loops use the configured three-cycle default, then route accumulated notes to recovery once and fail if the fixed DoD still cannot be approved.
|
||||
- `StageCheckpointReconciler` — reconciles checkpoint state across stage transitions.
|
||||
- Capability-gated failures first retry in place when the stage holds the required tool; an unchanged-fingerprint gate-budget exhaustion routes to the recovery/intent-holder stage when one is available, so capability possession alone cannot cause a frozen owner loop to fail the workflow.
|
||||
- Three repeated `REFERENCE_EXISTS` blocks for the same build prerequisite within one stage become a `workspace_precondition` gate failure, which is eligible for file-write recovery rather than remaining disconnected tool-call noise.
|
||||
- Every stage receives a small curated operating-guidance system entry: verify observed state, create required project setup, and resolve necessary scope edges without re-deliberating.
|
||||
- `JournalCompactionService` — triggers journal compaction and emits `JournalCompactedEvent`.
|
||||
- `OrchestratorEngines` / `OrchestratorRepositories` — dependency bundles for wiring.
|
||||
- `WorkspaceContext` / `WorkspaceToolRegistryProvider` — workspace-scoped tool registry provisioning.
|
||||
|
||||
+147
@@ -0,0 +1,147 @@
|
||||
package com.correx.core.kernel.concept
|
||||
|
||||
import com.correx.core.events.events.ConceptPromotedEvent
|
||||
import com.correx.core.events.events.FileWrittenEvent
|
||||
import com.correx.core.events.events.RetryAttemptedEvent
|
||||
import com.correx.core.events.events.StageCompletedEvent
|
||||
import com.correx.core.events.events.StageFailedEvent
|
||||
import com.correx.core.events.events.StoredEvent
|
||||
import com.correx.core.events.events.WorkflowFailedEvent
|
||||
import com.correx.core.sessions.projections.Projection
|
||||
|
||||
/** Default validated-fix count a fingerprint must reach before promotion (design §"Promotion rule"). */
|
||||
const val DEFAULT_PROMOTION_THRESHOLD = 3
|
||||
|
||||
/**
|
||||
* A recurring failure and its resolution tally, keyed by [classKey] (design 2026-07-12
|
||||
* §"Promote to a class key"). The class key is `gate + normalized(signature)`, so near-identical
|
||||
* failures that differ only in volatile tokens (paths, line numbers, hashes) aggregate into one
|
||||
* reusable concept instead of a fresh cluster per exact fingerprint. The exact [fingerprint] is
|
||||
* retained for the last-seen instance (retrieval-friendly, and the L3 instance-recall id).
|
||||
*/
|
||||
data class ConceptCluster(
|
||||
val classKey: String,
|
||||
val fingerprint: String,
|
||||
val gate: String,
|
||||
// First line of the recurring failure reason — the retrieval-friendly signature.
|
||||
val signature: String,
|
||||
// Count of times a stage retrying this class went on to complete = validated failure→fix.
|
||||
val validatedFixes: Int = 0,
|
||||
// Any StageFailed / WorkflowFailed observed while this class was open: the fix did NOT hold.
|
||||
val contradicted: Boolean = false,
|
||||
// The validated fix: CAS path + post-image hash of the last file the resolving stage wrote before
|
||||
// completing. Null until a fix→complete pair carries a file write. First captured ref wins.
|
||||
val fixPath: String? = null,
|
||||
val fixHash: String? = null,
|
||||
)
|
||||
|
||||
/** A failure currently being fought by a stage — resolved by the next StageCompleted/Failed. */
|
||||
data class OpenFailure(val classKey: String, val fingerprint: String, val gate: String, val signature: String)
|
||||
|
||||
/**
|
||||
* Normalize a failure signature into a reusable class dimension: lowercase, collapse digit runs and
|
||||
* quoted/pathish tokens to placeholders so `src/App.tsx:12` and `src/Nav.tsx:88` map to one class.
|
||||
* Deterministic (replay-safe) — pure string transform, no environment read.
|
||||
*/
|
||||
fun conceptClassKey(gate: String, signature: String): String {
|
||||
val normalized = signature.lowercase()
|
||||
.replace(Regex("""['"`][^'"`]*['"`]"""), "<str>")
|
||||
.replace(Regex("""\b[\w./\\-]+\.[a-z0-9]{1,5}\b"""), "<path>")
|
||||
.replace(Regex("""\d+"""), "#")
|
||||
.replace(Regex("""\s+"""), " ")
|
||||
.trim()
|
||||
return "$gate:$normalized"
|
||||
}
|
||||
|
||||
data class ConceptCompilerState(
|
||||
// Keyed by classKey (design §"Promote to a class key").
|
||||
val clusters: Map<String, ConceptCluster> = emptyMap(),
|
||||
// classKeys already emitted as ConceptPromotedEvent — folded back so replay never re-promotes.
|
||||
val promoted: Set<String> = emptySet(),
|
||||
// Per-stage open failure the stage is retrying; keyed by "sessionId/stageId" so concurrent sessions
|
||||
// in one cross-session fold don't collide.
|
||||
val open: Map<String, OpenFailure> = emptyMap(),
|
||||
// Last file write observed per session — the candidate validated-fix ref attached when the session's
|
||||
// open failure resolves as fixed. Keyed by sessionId; execution is sequential so one stage writes at
|
||||
// a time. Cleared on resolve so a later stage's writes don't back-attribute to an earlier fix.
|
||||
val lastWrite: Map<String, Pair<String, String>> = emptyMap(),
|
||||
) {
|
||||
/**
|
||||
* Clusters that have earned promotion but haven't been emitted yet: validated ≥ [threshold], never
|
||||
* contradicted, not already promoted. Pure — the caller (a service) appends the ConceptPromotedEvent.
|
||||
*/
|
||||
fun promotable(threshold: Int = DEFAULT_PROMOTION_THRESHOLD): List<ConceptCluster> =
|
||||
clusters.values.filter {
|
||||
it.classKey !in promoted && !it.contradicted && it.validatedFixes >= threshold
|
||||
}
|
||||
}
|
||||
|
||||
/**
|
||||
* Read-only projection over the event log that clusters validated failure→fix pairs by
|
||||
* [RetryAttemptedEvent.fingerprint] (gate-agnostic — contract/review/plan-compile/lint/static all
|
||||
* flow through the same retry event) and tracks which fingerprints are promotable. Fed the full
|
||||
* cross-session stream by its driver; the fold is deterministic and replayable (invariant #8).
|
||||
*
|
||||
* Signal: a stage emits RetryAttemptedEvent(fingerprint=fp) then StageCompleted ⇒ fp was validated-fixed.
|
||||
* A StageFailed/WorkflowFailed while fp is still open ⇒ the fix didn't hold (contradiction).
|
||||
*/
|
||||
class ConceptCompilerProjection : Projection<ConceptCompilerState> {
|
||||
|
||||
override fun initial() = ConceptCompilerState()
|
||||
|
||||
override fun apply(state: ConceptCompilerState, event: StoredEvent): ConceptCompilerState =
|
||||
when (val p = event.payload) {
|
||||
is RetryAttemptedEvent -> {
|
||||
val key = "${p.sessionId.value}/${p.stageId.value}"
|
||||
val sig = p.failureReason.lineSequence().firstOrNull()?.take(SIGNATURE_MAX)?.trim().orEmpty()
|
||||
val classKey = conceptClassKey(p.gate, sig)
|
||||
state.copy(open = state.open + (key to OpenFailure(classKey, p.fingerprint, p.gate, sig)))
|
||||
}
|
||||
is FileWrittenEvent -> p.postImageHash?.let {
|
||||
state.copy(lastWrite = state.lastWrite + (p.sessionId.value to (p.path to it)))
|
||||
} ?: state
|
||||
is StageCompletedEvent -> resolve(state, "${p.sessionId.value}/${p.stageId.value}", fixed = true)
|
||||
is StageFailedEvent -> resolve(state, "${p.sessionId.value}/${p.stageId.value}", fixed = false)
|
||||
is WorkflowFailedEvent -> failAllInSession(state, p.sessionId.value)
|
||||
is ConceptPromotedEvent -> state.copy(promoted = state.promoted + p.classKey)
|
||||
else -> state
|
||||
}
|
||||
|
||||
private fun resolve(state: ConceptCompilerState, key: String, fixed: Boolean): ConceptCompilerState {
|
||||
val failure = state.open[key] ?: return state
|
||||
val sessionId = key.substringBefore('/')
|
||||
val existing = state.clusters[failure.classKey]
|
||||
?: ConceptCluster(failure.classKey, failure.fingerprint, failure.gate, failure.signature)
|
||||
val updated = if (fixed) {
|
||||
val fix = state.lastWrite[sessionId]
|
||||
existing.copy(
|
||||
// Keep the latest instance's fingerprint/signature for recall.
|
||||
fingerprint = failure.fingerprint,
|
||||
signature = failure.signature,
|
||||
validatedFixes = existing.validatedFixes + 1,
|
||||
// First captured ref wins — keep the earliest validated fix as the canonical resolution.
|
||||
fixPath = existing.fixPath ?: fix?.first,
|
||||
fixHash = existing.fixHash ?: fix?.second,
|
||||
)
|
||||
} else {
|
||||
existing.copy(contradicted = true)
|
||||
}
|
||||
return state.copy(
|
||||
clusters = state.clusters + (failure.classKey to updated),
|
||||
open = state.open - key,
|
||||
lastWrite = state.lastWrite - sessionId,
|
||||
)
|
||||
}
|
||||
|
||||
// A workflow that failed terminally contradicts every fingerprint still open in that session.
|
||||
private fun failAllInSession(state: ConceptCompilerState, sessionId: String): ConceptCompilerState {
|
||||
val prefix = "$sessionId/"
|
||||
var acc = state
|
||||
state.open.keys.filter { it.startsWith(prefix) }.forEach { acc = resolve(acc, it, fixed = false) }
|
||||
return acc
|
||||
}
|
||||
|
||||
private companion object {
|
||||
const val SIGNATURE_MAX = 200
|
||||
}
|
||||
}
|
||||
+47
-2
@@ -10,6 +10,8 @@ import com.correx.core.context.model.ContextLayer
|
||||
import com.correx.core.context.model.EntryRole
|
||||
import com.correx.core.events.events.FailureTicketOpenedEvent
|
||||
import com.correx.core.events.events.InitialIntentEvent
|
||||
import com.correx.core.events.events.PlanGroundingEvaluatedEvent
|
||||
import com.correx.core.events.events.PlanGroundingVerdict
|
||||
import com.correx.core.events.events.RefinementIterationEvent
|
||||
import com.correx.core.events.events.RetryAttemptedEvent
|
||||
import com.correx.core.events.events.StoredEvent
|
||||
@@ -40,6 +42,35 @@ fun buildRetryFeedbackEntry(events: List<StoredEvent>, stageId: StageId): Contex
|
||||
)
|
||||
}
|
||||
|
||||
/**
|
||||
* Feeds the deterministic plan-grounding findings back into the architect stage when the freestyle
|
||||
* driver returned its plan for another attempt (grounding verdict != PASS). The findings are already
|
||||
* recorded on [PlanGroundingEvaluatedEvent] (invariant #9), so this reads them rather than re-deriving.
|
||||
* Gated to the plan-producing stage — "architect" in freestyle_planning, the same stage id the driver
|
||||
* stamps on rejection. Last event wins: a re-run that grounds PASS clears the feedback automatically.
|
||||
*/
|
||||
fun buildGroundingFeedbackEntry(events: List<StoredEvent>, stageId: StageId): ContextEntry? {
|
||||
if (stageId.value != "architect") return null
|
||||
val latest = events.mapNotNull { it.payload as? PlanGroundingEvaluatedEvent }.lastOrNull() ?: return null
|
||||
if (latest.verdict == PlanGroundingVerdict.PASS) return null
|
||||
val content = "## Plan grounding feedback\n" +
|
||||
"Your previous execution_plan was returned — it does not hold against the workspace facts:\n" +
|
||||
latest.findings.joinToString("\n") { "- $it" } + "\n" +
|
||||
"Emit a corrected plan that resolves every point above. Typical fixes: declare the manifest a " +
|
||||
"build stage needs (have an earlier stage create it via `writes`/`expectedFiles`), narrow a " +
|
||||
"stage's `touches` to paths that exist or that an earlier stage creates, or drop a build stage " +
|
||||
"that has nothing to build. Do not repeat the identical plan."
|
||||
return ContextEntry(
|
||||
id = ContextEntryId(UUID.randomUUID().toString()),
|
||||
layer = ContextLayer.L1,
|
||||
content = content,
|
||||
sourceType = "groundingFeedback",
|
||||
sourceId = stageId.value,
|
||||
tokenEstimate = content.length / 4,
|
||||
role = EntryRole.SYSTEM,
|
||||
)
|
||||
}
|
||||
|
||||
/**
|
||||
* Feeds the open failure ticket into the recovery stage's context. The recovery stage was entered
|
||||
* by kernel routing (not a normal edge) precisely because an upstream write-less stage failed a gate
|
||||
@@ -51,10 +82,24 @@ fun buildRecoveryTicketEntry(events: List<StoredEvent>, stageId: StageId): Conte
|
||||
val ticket = events
|
||||
.mapNotNull { it.payload as? FailureTicketOpenedEvent }
|
||||
.lastOrNull { it.routeTo == stageId } ?: return null
|
||||
val content = if (ticket.escalated) {
|
||||
val intent = events.mapNotNull { it.payload as? InitialIntentEvent }.lastOrNull()?.intent
|
||||
val content = if (ticket.gate == STAGE_LOOP_BREAK_GATE) {
|
||||
// A stuck-loop route is NOT a cross-file contract dispute — the gate output names no files, it
|
||||
// is the SAME action (often a malformed tool call) repeated until the loop-break tripped. The
|
||||
// arbitration prompt (read/reconcile the named files) sends the model hunting for files that
|
||||
// don't exist. Tell it plainly: the last action is futile, take a materially different one.
|
||||
"## Stuck-loop ticket\n" +
|
||||
"Stage '${ticket.stageId.value}' repeated the SAME failing action until it tripped the " +
|
||||
"'${ticket.gate}' gate. Retrying that action again is futile — it will fail identically. The " +
|
||||
"exact failure is below; it is a single stuck step, NOT a dispute between files, so do not go " +
|
||||
"looking for files to reconcile. If it is a malformed tool call, fix the call's shape and " +
|
||||
"continue the task; otherwise take a materially different route to the same goal. Serve the " +
|
||||
"intent" + (intent?.let { " below" } ?: "") + ", then control returns to verification." +
|
||||
(intent?.let { "\n### Intent (authoritative)\n$it" } ?: "") +
|
||||
"\n### Gate output (the failing action)\n${ticket.evidence}"
|
||||
} else if (ticket.escalated) {
|
||||
// Tier 2: the owner loop couldn't settle it — a cross-file contract dispute. The arbiter holds
|
||||
// the intent and reconciles ALL sides in one pass.
|
||||
val intent = events.mapNotNull { it.payload as? InitialIntentEvent }.lastOrNull()?.intent
|
||||
"## Contract arbitration ticket\n" +
|
||||
"Stage '${ticket.stageId.value}' keeps failing the '${ticket.gate}' gate even after the " +
|
||||
"file owners repaired their own layers — so this is NOT a bug in one file. The files named " +
|
||||
|
||||
+52
-9
@@ -15,6 +15,7 @@ import com.correx.core.events.events.OrchestrationResumedEvent
|
||||
import com.correx.core.events.events.SteeringNoteAddedEvent
|
||||
import com.correx.core.events.events.StoredEvent
|
||||
import com.correx.core.events.events.TransitionExecutedEvent
|
||||
import com.correx.core.events.events.WorkflowStartedEvent
|
||||
import com.correx.core.events.orchestration.OrchestrationState
|
||||
import com.correx.core.events.types.ApprovalDecisionId
|
||||
import com.correx.core.events.types.ApprovalRequestId
|
||||
@@ -65,12 +66,32 @@ internal val EVIDENCE_PATH_RE = Regex("""[\w./@-]+\.[A-Za-z0-9]+""")
|
||||
|
||||
// Deterministic gate id → capability the failing stage must hold to change the failure condition.
|
||||
// A gate not listed here is not eligible for recovery routing (retries in place as before).
|
||||
// Gate id for a repeated missing build prerequisite (design #163/#170). Its own separate handling
|
||||
// (bounded bootstrap turn / recovery routing) is triggered off this id before the normal retry path.
|
||||
internal const val WORKSPACE_PRECONDITION_GATE = "workspace_precondition"
|
||||
|
||||
// Gate id for a provably-stuck stage failure loop (Vikunja #78). Detected by repeatedToolFailureLoop
|
||||
// when the SAME tool-failure signature recurs past the tuning limit; routed straight to recovery
|
||||
// (never retried in place) by the step handler before the normal retry path.
|
||||
internal const val STAGE_LOOP_BREAK_GATE = "stage_loop_break"
|
||||
|
||||
internal val GATE_REQUIRED_CAPABILITY: Map<String, String> = mapOf(
|
||||
"execution" to "file_write",
|
||||
"contract" to "file_write",
|
||||
"static_analysis" to "file_write",
|
||||
WORKSPACE_PRECONDITION_GATE to "file_write",
|
||||
)
|
||||
|
||||
// ponytail: trimmed to the single non-redundant sentence after the 2026-07-16 audition
|
||||
// (docs/qa/QA-stage-prompt-audition-results-2026-07-16.md) found the full block performance-neutral —
|
||||
// the read-before-write / verify-before-complete / use-exact-feedback nudges just restate behavior the
|
||||
// gates already enforce, and run 3 proved prose doesn't stop failure loops (deterministic defenses do).
|
||||
// Only the scaffolding-scope boundary encodes a decision no gate makes. Delete outright if a future
|
||||
// multi-fixture audit still shows no clarity value.
|
||||
internal const val CURATED_STAGE_OPERATING_GUIDANCE = """## Operating guidance
|
||||
When the authoritative intent plainly requires project setup, creating its manifest, configuration,
|
||||
or entry file is in scope; do not spend turns re-deciding that settled boundary."""
|
||||
|
||||
// Deterministic failure category from the gate id (no LLM — keeps routing off the untrusted path).
|
||||
internal fun ticketCategory(gate: String): String = when (gate) {
|
||||
"plan_compile" -> "planning"
|
||||
@@ -110,15 +131,30 @@ class DefaultSessionOrchestrator(
|
||||
sessionId: SessionId,
|
||||
graph: WorkflowGraph,
|
||||
config: OrchestrationConfig,
|
||||
): WorkflowResult {
|
||||
log.debug("[Orchestrator] session={} workflow={} start={}", sessionId.value, graph.id, graph.start.value)
|
||||
emitWorkflowStarted(sessionId, graph, config)
|
||||
): WorkflowResult = runFrom(sessionId, graph, config, graph.start)
|
||||
|
||||
val base = ExecutionContext(graph, sessionId, 0, graph.start, config, null, null)
|
||||
/**
|
||||
* Runs [graph] entering at [startStage] instead of [graph].start. Used by the freestyle
|
||||
* return-to-architect loop to re-enter just the plan-producing stage (with grounding feedback
|
||||
* already in its L1 context) without redoing discovery/analyst. [startStage] must be in [graph].
|
||||
*/
|
||||
suspend fun runFrom(
|
||||
sessionId: SessionId,
|
||||
graph: WorkflowGraph,
|
||||
config: OrchestrationConfig,
|
||||
startStage: StageId,
|
||||
): WorkflowResult {
|
||||
require(graph.stages.containsKey(startStage)) {
|
||||
"startStage '${startStage.value}' is not a stage of workflow '${graph.id}'"
|
||||
}
|
||||
log.debug("[Orchestrator] session={} workflow={} start={}", sessionId.value, graph.id, startStage.value)
|
||||
emitWorkflowStarted(sessionId, graph, config, startStage)
|
||||
|
||||
val base = ExecutionContext(graph, sessionId, 0, startStage, config, null, null)
|
||||
val enriched = base.enrich()
|
||||
|
||||
// Execute the start stage before entering the step loop
|
||||
return when (val result = enterStage(enriched, graph.start)) {
|
||||
return when (val result = enterStage(enriched, startStage)) {
|
||||
is StepResult.Continue -> step(result.ctx)
|
||||
is StepResult.Terminal -> result.result
|
||||
}
|
||||
@@ -206,8 +242,8 @@ class DefaultSessionOrchestrator(
|
||||
|
||||
/**
|
||||
* Delivers the operator's answers to a pending clarification raised by a stage. The waiting
|
||||
* stage (parked in [requestClarificationIfNeeded]) completes and re-runs with the answers in
|
||||
* context. If the server restarted while the clarification was pending there is no live
|
||||
* stage (parked in [requestClarificationIfNeeded]) unparks and the run advances to the next
|
||||
* stage with the answers in context. If the server restarted while the clarification was pending there is no live
|
||||
* coroutine to complete, so the answers are recorded directly and the session resumed.
|
||||
*/
|
||||
suspend fun submitClarification(
|
||||
@@ -260,10 +296,17 @@ class DefaultSessionOrchestrator(
|
||||
)
|
||||
}
|
||||
|
||||
// A back-edge re-enters a stage already transitioned into this run (e.g. reviewer→implementer).
|
||||
// A back-edge re-enters any stage already visited this run (e.g. reviewer→implementer). The start
|
||||
// stage is visited via WorkflowStarted rather than TransitionExecuted, so it must participate too.
|
||||
// Top-level (not a member) to keep the orchestrator off the TooManyFunctions threshold.
|
||||
internal fun isBackEdge(events: List<StoredEvent>, target: StageId): Boolean =
|
||||
events.any { (it.payload as? TransitionExecutedEvent)?.to == target }
|
||||
events.any {
|
||||
when (val payload = it.payload) {
|
||||
is WorkflowStartedEvent -> payload.startStageId == target
|
||||
is TransitionExecutedEvent -> payload.to == target
|
||||
else -> false
|
||||
}
|
||||
}
|
||||
|
||||
internal sealed class StepResult {
|
||||
data class Continue(val ctx: EnrichedExecutionContext) : StepResult()
|
||||
|
||||
+4
-3
@@ -44,8 +44,9 @@ internal suspend fun DefaultSessionOrchestrator.retryStageOrFail(
|
||||
* capability — bounded by the stage's own [RECOVERY_ROUTE_BUDGET].
|
||||
*
|
||||
* Returns a [StepResult] when it took over the failure (routed, or budget-exhausted terminal),
|
||||
* or null to fall through to the normal per-gate retry path. Null in every backward-compatible
|
||||
* case: gate not capability-gated, stage already has the capability, or no recovery stage exists.
|
||||
* or null to fall through to the normal per-gate retry path. A stage that already holds the
|
||||
* capability retries in place first; its unchanged-fingerprint retry exhaustion is separately
|
||||
* routed from the step loop, because capability possession does not prove the owner can apply it.
|
||||
*/
|
||||
|
||||
internal suspend fun DefaultSessionOrchestrator.maybeRouteToRecovery(
|
||||
@@ -56,7 +57,7 @@ internal suspend fun DefaultSessionOrchestrator.maybeRouteToRecovery(
|
||||
): StepResult? {
|
||||
val requiredCapability = GATE_REQUIRED_CAPABILITY[failure.gate] ?: return null
|
||||
val stageTools = ctx.graph.stages[stageId]?.allowedTools ?: emptySet()
|
||||
if (requiredCapability in stageTools) return null // stage has agency — retry in place is valid
|
||||
if (requiredCapability in stageTools) return null // retry in place before no-progress exhaustion
|
||||
return routeToRecovery(ctx, stageId, failure.gate, requiredCapability, failure.reason, state)
|
||||
}
|
||||
|
||||
|
||||
+78
-6
@@ -5,6 +5,7 @@ import com.correx.core.artifacts.ArtifactState
|
||||
import com.correx.core.events.events.ApprovalDecisionResolvedEvent
|
||||
import com.correx.core.events.events.ApprovalRequestedEvent
|
||||
import com.correx.core.events.events.ArtifactValidatedEvent
|
||||
import com.correx.core.events.events.FailureTicketOpenedEvent
|
||||
import com.correx.core.events.events.RefinementIterationEvent
|
||||
import com.correx.core.events.events.RetrySalvageDecidedEvent
|
||||
import com.correx.core.events.events.SalvageDecision
|
||||
@@ -135,6 +136,7 @@ internal tailrec suspend fun DefaultSessionOrchestrator.step(ctx: EnrichedExecut
|
||||
* re-execute the same stage if attempts remain, else fail terminally with retryExhausted=true.
|
||||
*/
|
||||
|
||||
@Suppress("LongMethod", "ReturnCount", "NestedBlockDepth")
|
||||
internal suspend fun DefaultSessionOrchestrator.executeMove(
|
||||
ctx: EnrichedExecutionContext,
|
||||
decision: TransitionDecision.Move,
|
||||
@@ -154,10 +156,43 @@ internal suspend fun DefaultSessionOrchestrator.executeMove(
|
||||
// terminal failure instead of looping forever.
|
||||
if (isBackEdge(repositories.eventStore.read(ctx.sessionId), nextStageId)) {
|
||||
val cycleKey = "${ctx.currentStageId.value}->${nextStageId.value}"
|
||||
val maxIterations = ctx.graph.stages[nextStageId]?.maxRetries ?: tuning.defaultMaxRefinement
|
||||
val reviewerRole = ctx.graph.stages[ctx.currentStageId]?.metadata?.get("role")?.lowercase()
|
||||
val reviewLoop = reviewerRole in setOf("review", "reviewer")
|
||||
val maxIterations = if (reviewLoop) {
|
||||
tuning.reviewLoopMaxCycles
|
||||
} else {
|
||||
ctx.graph.stages[nextStageId]?.maxRetries ?: tuning.defaultMaxRefinement
|
||||
}
|
||||
val iteration = (orchestrationRepository.getState(ctx.sessionId).refinementIterations[cycleKey] ?: 0) + 1
|
||||
emit(ctx.sessionId, RefinementIterationEvent(ctx.sessionId, cycleKey, iteration, maxIterations))
|
||||
if (iteration > maxIterations) {
|
||||
if (reviewLoop) {
|
||||
val events = repositories.eventStore.read(ctx.sessionId)
|
||||
val alreadyRecovered = events.mapNotNull { it.payload as? FailureTicketOpenedEvent }
|
||||
.any { it.gate == REVIEW_LOOP_GATE && it.stageId == ctx.currentStageId }
|
||||
val notes = ctx.graph.stages[ctx.currentStageId]?.produces
|
||||
?.mapNotNull { artifactContentCache["${ctx.sessionId.value}:${it.name.value}"] }
|
||||
?.joinToString("\n\n")
|
||||
.orEmpty()
|
||||
val reason = "review loop exhausted after exactly $maxIterations cycles. " +
|
||||
"The fixed DoD was not approved. Accumulated review notes:\n" +
|
||||
notes.ifBlank { "(review stage emitted no retained notes)" }
|
||||
if (!alreadyRecovered) {
|
||||
return routeToRecovery(
|
||||
ctx,
|
||||
ctx.currentStageId,
|
||||
REVIEW_LOOP_GATE,
|
||||
"review_convergence",
|
||||
reason,
|
||||
orchestrationRepository.getState(ctx.sessionId),
|
||||
) ?: StepResult.Terminal(
|
||||
failWorkflow(ctx.sessionId, ctx.currentStageId, reason, retryExhausted = true),
|
||||
)
|
||||
}
|
||||
return StepResult.Terminal(
|
||||
failWorkflow(ctx.sessionId, ctx.currentStageId, reason, retryExhausted = true),
|
||||
)
|
||||
}
|
||||
return StepResult.Terminal(
|
||||
failWorkflow(
|
||||
ctx.sessionId,
|
||||
@@ -179,6 +214,8 @@ internal suspend fun DefaultSessionOrchestrator.executeMove(
|
||||
}
|
||||
}
|
||||
|
||||
private const val REVIEW_LOOP_GATE = "review_loop"
|
||||
|
||||
@Suppress("ReturnCount")
|
||||
internal suspend fun DefaultSessionOrchestrator.enterStage(
|
||||
ctx: EnrichedExecutionContext,
|
||||
@@ -224,11 +261,13 @@ internal suspend fun DefaultSessionOrchestrator.enterStage(
|
||||
).outcome
|
||||
when (result) {
|
||||
is StageExecutionResult.Success -> {
|
||||
if (requestClarificationIfNeeded(ctx.sessionId, stageId, ctx.graph)) {
|
||||
// The stage raised open questions and the operator answered them; loop to
|
||||
// re-run the stage with the answers injected (no failure-retry budget spent).
|
||||
continue
|
||||
}
|
||||
// The stage may emit open questions in its artifact (discovery does). Park, let the
|
||||
// operator answer, and record the answers — then ADVANCE, do not re-run the stage.
|
||||
// A re-run restarts inference with no prior CoT, so the stage re-explores instead of
|
||||
// converging (2026-07-18). The answers are recorded as ClarificationAnsweredEvents
|
||||
// and injected into every later stage's L0 context (buildClarificationAnswerEntries),
|
||||
// so the next stage (e.g. analyst) sees them without discovery running again.
|
||||
requestClarificationIfNeeded(ctx.sessionId, stageId, ctx.graph)
|
||||
compactionService?.let { svc ->
|
||||
val journalState = decisionJournalRepository.getJournal(ctx.sessionId)
|
||||
val journalText = DecisionJournalRenderer().render(journalState)
|
||||
@@ -254,6 +293,25 @@ internal suspend fun DefaultSessionOrchestrator.enterStage(
|
||||
return StepResult.Continue(ctx.copy(stageCount = ctx.stageCount + 1))
|
||||
}
|
||||
val refreshedState = orchestrationRepository.getState(ctx.sessionId)
|
||||
// A repeated missing-build-prerequisite block is not an ordinary retry: it takes a
|
||||
// bounded, separately-budgeted precondition-resolution path (design #170) that never
|
||||
// charges the stage retry counter. FallThrough = defer to the normal recovery routing.
|
||||
if (result.gate == WORKSPACE_PRECONDITION_GATE) {
|
||||
when (val outcome = buildPrerequisiteDecision(ctx, stageId, result, refreshedState)) {
|
||||
PrerequisiteOutcome.Bootstrap -> continue // re-run stage, no retry charged
|
||||
PrerequisiteOutcome.FallThrough -> Unit // non-writable → recovery routing below
|
||||
is PrerequisiteOutcome.Done -> return outcome.result
|
||||
}
|
||||
}
|
||||
// A proven same-signature failure loop (Vikunja #78) must never be retried in place —
|
||||
// retrying is what got us here. Route straight to recovery regardless of capability;
|
||||
// terminal if the graph offers no recovery route.
|
||||
if (result.gate == STAGE_LOOP_BREAK_GATE) {
|
||||
return routeToRecovery(ctx, stageId, result.gate, "file_write", result.reason, refreshedState)
|
||||
?: StepResult.Terminal(
|
||||
failWorkflow(ctx.sessionId, stageId, result.reason, retryExhausted = true),
|
||||
)
|
||||
}
|
||||
// Retry-agency invariant: a gate this stage lacks the capability to fix must not
|
||||
// be retried in place (futile). Route to a recovery stage that holds the
|
||||
// capability, if one exists and the route budget remains.
|
||||
@@ -269,6 +327,20 @@ internal suspend fun DefaultSessionOrchestrator.enterStage(
|
||||
when (gateDecision) {
|
||||
RetryDecision.Retry -> Unit // retry — loop and re-execute
|
||||
RetryDecision.Exhausted -> {
|
||||
// A stage may hold the nominal capability yet repeatedly fail to apply it
|
||||
// (scope paralysis / frozen ReAct loop). Exhaustion is only returned for an
|
||||
// unchanged fingerprint, so hand that no-progress dead-end to the
|
||||
// intent-holder rather than declaring the workflow failed in place.
|
||||
GATE_REQUIRED_CAPABILITY[result.gate]?.let { capability ->
|
||||
routeToRecovery(
|
||||
ctx,
|
||||
stageId,
|
||||
result.gate,
|
||||
capability,
|
||||
result.reason,
|
||||
refreshedState,
|
||||
)?.let { return it }
|
||||
}
|
||||
decideGateExhaustion(
|
||||
ctx, stageId, result.gate, result.reason, refreshedState,
|
||||
)?.let { return it }
|
||||
|
||||
+4
-2
@@ -43,7 +43,10 @@ class JournalCompactionService(
|
||||
}
|
||||
|
||||
val summaryArtifactId = artifactStore.put(summaryText.toByteArray(Charsets.UTF_8))
|
||||
artifactStore.flushBefore {
|
||||
// Emit directly, NOT inside flushBefore { }: append() already fsyncs artifacts before it
|
||||
// persists the event, so wrapping the emit here re-acquires the (non-reentrant) artifact
|
||||
// Mutex that flushBefore already holds → self-deadlock. Only surfaces on long runs, which
|
||||
// are the ones that cross the compaction threshold.
|
||||
emit(
|
||||
JournalCompactedEvent(
|
||||
sessionId = sessionId,
|
||||
@@ -52,7 +55,6 @@ class JournalCompactionService(
|
||||
lowSalienceOmittedCount = lowCount,
|
||||
),
|
||||
)
|
||||
}
|
||||
return true
|
||||
}
|
||||
}
|
||||
|
||||
+20
@@ -0,0 +1,20 @@
|
||||
package com.correx.core.kernel.orchestration
|
||||
|
||||
import com.correx.core.events.events.LspDiagnostic
|
||||
import java.nio.file.Path
|
||||
|
||||
data class LspDiagnosticsRequest(
|
||||
val workspaceRoot: Path,
|
||||
val paths: List<String>,
|
||||
)
|
||||
|
||||
data class LspDiagnosticsResult(
|
||||
val server: String? = null,
|
||||
val diagnostics: List<LspDiagnostic> = emptyList(),
|
||||
val skippedReason: String? = null,
|
||||
)
|
||||
|
||||
/** Nondeterministic LSP boundary. The orchestrator records its result before using it. */
|
||||
fun interface LspDiagnosticsRunner {
|
||||
suspend fun pull(request: LspDiagnosticsRequest): LspDiagnosticsResult
|
||||
}
|
||||
+8
@@ -35,10 +35,18 @@ data class OrchestrationTuning(
|
||||
val reviewBlockMinConfidence: Double = 0.7,
|
||||
/** Pathological backstop: max review-driven retries before the stage is let through. */
|
||||
val reviewBlockRetryCap: Int = 20,
|
||||
/** Review→rework cycles before deterministic escalation to recovery. */
|
||||
val reviewLoopMaxCycles: Int = 3,
|
||||
/** Max review→refine cycles for a stage (freestyle default refinement budget). */
|
||||
val defaultMaxRefinement: Int = 3,
|
||||
/** Budget for routing a failed write-less stage to a recovery stage. */
|
||||
val recoveryRouteBudget: Int = 2,
|
||||
/** Budget for tier-2 intent-holder arbiter re-routing. */
|
||||
val intentRouteBudget: Int = 2,
|
||||
/**
|
||||
* Cumulative same-signature tool failures within a stage before it's broken out of the loop and
|
||||
* routed to recovery (Vikunja #78). Unlike the consecutive read/rejection nudges, this survives
|
||||
* interleaved successes — it counts a normalized failure signature across the whole stage.
|
||||
*/
|
||||
val stageFailureLoopLimit: Int = 6,
|
||||
)
|
||||
|
||||
+1
@@ -31,6 +31,7 @@ data class OrchestratorEngines(
|
||||
// Runs operator-configured static-analysis commands as a harness step (role-reliability §5).
|
||||
// Null = no static-first step; a stage declaring `static_analysis` then no-ops with a warning.
|
||||
val staticAnalysisRunner: StaticAnalysisRunner? = null,
|
||||
val lspDiagnosticsRunner: LspDiagnosticsRunner? = null,
|
||||
// Evaluates Gate 2 contract assertions against a stage's produced files (design §1). Null = no
|
||||
// contract gate; the deterministic funnel then rests on produces-presence + static analysis only.
|
||||
val contractAssertionEvaluator: ContractAssertionEvaluator? = null,
|
||||
|
||||
+44
-4
@@ -4,6 +4,7 @@ import com.correx.core.tools.process.ChildProcess
|
||||
import kotlinx.coroutines.Dispatchers
|
||||
import kotlinx.coroutines.TimeoutCancellationException
|
||||
import kotlinx.coroutines.async
|
||||
import kotlinx.coroutines.coroutineScope
|
||||
import kotlinx.coroutines.withContext
|
||||
import kotlinx.coroutines.withTimeout
|
||||
import java.nio.file.Path
|
||||
@@ -26,23 +27,61 @@ class ProcessStaticAnalysisRunner(
|
||||
withContext(Dispatchers.IO) {
|
||||
val argv = command.trim().split(WHITESPACE).filter { it.isNotEmpty() }
|
||||
if (argv.isEmpty()) return@withContext StaticAnalysisRunResult(EXIT_NOT_RUN, "empty command")
|
||||
if (argv.first() == STATIC_FLOOR_COMMAND) return@withContext runStaticFloor(workingDir, argv)
|
||||
runProcess(workingDir, argv, command)
|
||||
}
|
||||
|
||||
@Suppress("ReturnCount")
|
||||
private suspend fun runStaticFloor(workingDir: Path, argv: List<String>): StaticAnalysisRunResult {
|
||||
val paths = argv.dropWhile { it != "--" }.drop(1)
|
||||
if (paths.isEmpty()) return StaticAnalysisRunResult(0, "static floor skipped: no concrete files")
|
||||
val checks = paths.mapNotNull { path -> checkerFor(path)?.let { it + path } }
|
||||
if (checks.isEmpty()) {
|
||||
return StaticAnalysisRunResult(0, "static floor skipped: no resolvable checker for ${paths.joinToString()}")
|
||||
}
|
||||
val outputs = mutableListOf<String>()
|
||||
for (check in checks) {
|
||||
val result = runProcess(workingDir, check, check.joinToString(" "))
|
||||
outputs += "${check.joinToString(" ")}: ${result.output}".trim()
|
||||
if (result.exitCode != 0) return StaticAnalysisRunResult(result.exitCode, outputs.joinToString("\n"))
|
||||
}
|
||||
val skipped = paths.size - checks.size
|
||||
if (skipped > 0) outputs += "static floor skipped $skipped file(s) without a checker"
|
||||
return StaticAnalysisRunResult(0, outputs.joinToString("\n"))
|
||||
}
|
||||
|
||||
private fun checkerFor(path: String): List<String>? = when (path.substringAfterLast('.', "").lowercase()) {
|
||||
"js", "mjs", "cjs" -> listOf("node", "--check")
|
||||
"py" -> listOf("python3", "-m", "py_compile")
|
||||
"sh", "bash" -> listOf("bash", "-n")
|
||||
"rb" -> listOf("ruby", "-c")
|
||||
else -> null
|
||||
}
|
||||
|
||||
private suspend fun runProcess(
|
||||
workingDir: Path,
|
||||
argv: List<String>,
|
||||
displayCommand: String,
|
||||
): StaticAnalysisRunResult {
|
||||
val process = runCatching {
|
||||
ChildProcess.builder(argv, workingDir.toFile()).redirectErrorStream(true).start()
|
||||
}.getOrElse {
|
||||
return@withContext StaticAnalysisRunResult(EXIT_NOT_RUN, "failed to start '$command': ${it.message}")
|
||||
return StaticAnalysisRunResult(EXIT_NOT_RUN, "failed to start '$displayCommand': ${it.message}")
|
||||
}
|
||||
runCatching {
|
||||
return runCatching {
|
||||
coroutineScope {
|
||||
withTimeout(timeoutMs) {
|
||||
val outputDeferred = async { process.inputStream.bufferedReader().use { it.readText() } }
|
||||
val exit = process.waitFor()
|
||||
StaticAnalysisRunResult(exit, outputDeferred.await())
|
||||
}
|
||||
}
|
||||
}.getOrElse {
|
||||
process.destroyForcibly()
|
||||
val reason = if (it is TimeoutCancellationException) {
|
||||
"static analysis '$command' timed out after ${timeoutMs}ms"
|
||||
"static analysis '$displayCommand' timed out after ${timeoutMs}ms"
|
||||
} else {
|
||||
it.message ?: "error running '$command'"
|
||||
it.message ?: "error running '$displayCommand'"
|
||||
}
|
||||
StaticAnalysisRunResult(EXIT_NOT_RUN, reason)
|
||||
}
|
||||
@@ -51,6 +90,7 @@ class ProcessStaticAnalysisRunner(
|
||||
private companion object {
|
||||
const val DEFAULT_TIMEOUT_MS = 300_000L
|
||||
const val EXIT_NOT_RUN = -1
|
||||
const val STATIC_FLOOR_COMMAND = "correx-static-floor"
|
||||
val WHITESPACE = Regex("\\s+")
|
||||
}
|
||||
}
|
||||
|
||||
+19
@@ -9,6 +9,8 @@ import com.correx.core.artifactstore.ArtifactStore
|
||||
import com.correx.core.context.builder.ContextPackBuilder
|
||||
import com.correx.core.context.model.ContextPack
|
||||
import com.correx.core.events.events.ClarificationAnswer
|
||||
import com.correx.core.events.events.ClarificationAnsweredEvent
|
||||
import com.correx.core.events.events.ClarificationRequestedEvent
|
||||
import com.correx.core.events.events.InferenceCompletedEvent
|
||||
import com.correx.core.events.events.InferenceFailedEvent
|
||||
import com.correx.core.events.events.InferenceStartedEvent
|
||||
@@ -212,6 +214,7 @@ abstract class SessionOrchestrator(
|
||||
internal val workspacePolicy: WorkspacePolicy? = engines.workspacePolicy
|
||||
internal val worldProbe: WorldProbe = engines.worldProbe
|
||||
internal val staticAnalysisRunner: StaticAnalysisRunner? = engines.staticAnalysisRunner
|
||||
internal val lspDiagnosticsRunner: LspDiagnosticsRunner? = engines.lspDiagnosticsRunner
|
||||
internal val contractAssertionEvaluator: ContractAssertionEvaluator? = engines.contractAssertionEvaluator
|
||||
internal val planCompilationCheck: PlanCompilationCheck? = engines.planCompilationCheck
|
||||
internal val semanticReviewer: SemanticReviewer? = engines.semanticReviewer
|
||||
@@ -259,6 +262,22 @@ abstract class SessionOrchestrator(
|
||||
fun liveClarificationRequestIds(): Set<String> =
|
||||
pendingClarifications.keys.mapTo(mutableSetOf()) { it.value }
|
||||
|
||||
/**
|
||||
* The clarification a headless caller should answer for this session: the newest still-live,
|
||||
* unanswered request. Null if the session is not parked on a clarification. Lets a REST answer
|
||||
* route resolve the (stageId, requestId) server-side so a script need only supply answer values —
|
||||
* the WS path knows them because it received the [ClarificationRequestedEvent]; a curl caller does not.
|
||||
*/
|
||||
suspend fun pendingClarificationFor(sessionId: SessionId): ClarificationRequestedEvent? {
|
||||
val live = liveClarificationRequestIds()
|
||||
if (live.isEmpty()) return null
|
||||
val events = eventStore.read(sessionId)
|
||||
val answered = events.mapNotNull { it.payload as? ClarificationAnsweredEvent }
|
||||
.mapTo(mutableSetOf()) { it.requestId }
|
||||
return events.mapNotNull { it.payload as? ClarificationRequestedEvent }
|
||||
.lastOrNull { it.requestId.value in live && it.requestId !in answered }
|
||||
}
|
||||
|
||||
/** Public seam for out-of-band gates (e.g. freestyle plan review) that reuse the stage-approval flow. */
|
||||
suspend fun requestPlanApproval(sessionId: SessionId, preview: String): Boolean =
|
||||
requestStageApproval(sessionId, StageId("plan_review"), preview)
|
||||
|
||||
+7
-4
@@ -76,7 +76,7 @@ internal suspend fun SessionOrchestrator.repairArtifact(
|
||||
if (eligible && bestCandidate != null && !isCancelled(sessionId)) {
|
||||
emitArtifactRepairAttempted(sessionId, stageId, slot, unresolved.classification, "LLM")
|
||||
val repaired = runArtifactRepairInference(
|
||||
sessionId, stageId, slot, bestCandidate, stageConfig, effectives, timeoutMs,
|
||||
sessionId, stageId, slot, bestCandidate, unresolved.detail, stageConfig, effectives, timeoutMs,
|
||||
)
|
||||
val reRun = repaired?.let { artifactExtractionPipeline.run(it, schema) }
|
||||
if (reRun is ArtifactExtractionPipeline.ExtractionResult.Resolved) {
|
||||
@@ -115,15 +115,18 @@ internal suspend fun SessionOrchestrator.runArtifactRepairInference(
|
||||
stageId: StageId,
|
||||
slot: TypedArtifactSlot,
|
||||
bestCandidate: String,
|
||||
validationError: String,
|
||||
stageConfig: StageConfig,
|
||||
effectives: RunEffectives,
|
||||
timeoutMs: Long,
|
||||
): String? {
|
||||
val schema = slot.kind.deriveJsonSchema()
|
||||
val schemaJson = Json.encodeToString(JsonSchema.serializer(), schema)
|
||||
val prompt = "The previous output for the '${slot.name.value}' artifact was malformed and did not " +
|
||||
"match the required schema.\n\nMalformed output:\n$bestCandidate\n\nReturn ONLY a single JSON " +
|
||||
"object matching this schema. Do not add fields, prose, or code fences.\nSchema: $schemaJson"
|
||||
val prompt = "The previous output for the '${slot.name.value}' artifact failed schema validation.\n\n" +
|
||||
"Validation error:\n$validationError\n\nMalformed output:\n$bestCandidate\n\nFix ONLY what the " +
|
||||
"validation error names — every field must sit at the level the schema defines; do not nest a " +
|
||||
"top-level field inside another object. Return ONLY a single JSON object matching this schema. " +
|
||||
"Do not add fields, prose, or code fences.\nSchema: $schemaJson"
|
||||
val entry = ContextEntry(
|
||||
id = ContextEntryId(UUID.randomUUID().toString()),
|
||||
layer = ContextLayer.L2,
|
||||
|
||||
+69
@@ -0,0 +1,69 @@
|
||||
package com.correx.core.kernel.orchestration
|
||||
|
||||
import com.correx.core.context.model.ContextEntry
|
||||
import com.correx.core.context.model.ContextLayer
|
||||
import com.correx.core.context.model.EntryRole
|
||||
import com.correx.core.events.events.ConceptPromotedEvent
|
||||
import com.correx.core.events.types.ContextEntryId
|
||||
import com.correx.core.kernel.concept.ConceptCompilerProjection
|
||||
import com.correx.core.transitions.graph.StageConfig
|
||||
import java.util.UUID
|
||||
|
||||
/**
|
||||
* Deterministic delivery of promoted capability-accretion concepts into a stage's context
|
||||
* (design 2026-07-12-acr-concept-compiler.md §"Delivery" — replaces the L3 top-k lottery as the
|
||||
* PRIMARY channel; L3 remains an instance-recall fallback). A [ConceptPromotedEvent] is the
|
||||
* authoritative record of a validated failure→fix class; injecting it as an L0/system block tells a
|
||||
* stage about a known resolution BEFORE it re-derives the same fix.
|
||||
*
|
||||
* Relevance filter (avoids the broadcast the design's verdict #1 rejected): only inject a concept a
|
||||
* stage could actually act on — a concept whose gate requires a capability ([GATE_REQUIRED_CAPABILITY])
|
||||
* the stage does not hold is skipped (no point telling a write-less verifier about a file_write fix).
|
||||
* Gates with no required capability (lint/review) are broadly relevant. Bounded to [limit] by
|
||||
* occurrences so context stays small. Pure over the promoted set → same input, same injection.
|
||||
*/
|
||||
internal fun selectPromotedConcepts(
|
||||
promoted: List<ConceptPromotedEvent>,
|
||||
allowedTools: Set<String>,
|
||||
contradicted: Set<String> = emptySet(),
|
||||
limit: Int = MAX_PROMOTED_CONCEPTS,
|
||||
): List<ConceptPromotedEvent> =
|
||||
promoted
|
||||
// Honor a contradiction observed AFTER promotion (design 2026-07-12 §"Decay/contradiction"):
|
||||
// a concept whose class later failed to hold must not keep being delivered as a known fix.
|
||||
.filter { it.classKey.ifBlank { it.fingerprint } !in contradicted }
|
||||
.filter { concept -> GATE_REQUIRED_CAPABILITY[concept.gate]?.let { it in allowedTools } ?: true }
|
||||
.distinctBy { it.classKey.ifBlank { it.fingerprint } }
|
||||
.sortedByDescending { it.occurrences }
|
||||
.take(limit)
|
||||
|
||||
/** L0/system context entries for the concepts relevant to [stageConfig], read from the whole log. */
|
||||
internal suspend fun SessionOrchestrator.promotedConceptEntries(stageConfig: StageConfig): List<ContextEntry> {
|
||||
val events = eventStore.allEvents().toList()
|
||||
val promoted = events.mapNotNull { it.payload as? ConceptPromotedEvent }
|
||||
if (promoted.isEmpty()) return emptyList()
|
||||
// Fold the same projection the compiler uses to find classes contradicted since promotion.
|
||||
val projection = ConceptCompilerProjection()
|
||||
val state = events.fold(projection.initial()) { s, e -> projection.apply(s, e) }
|
||||
val contradicted = state.clusters.values.filter { it.contradicted }.map { it.classKey }.toSet()
|
||||
return selectPromotedConcepts(promoted, stageConfig.effectiveAllowedTools, contradicted).map { concept ->
|
||||
// Deliver the FIX, not just a nag (design §"carry the fix"): when the accreted concept carries a
|
||||
// validated-fix ref, point the stage at the file that resolved this class before, so it applies a
|
||||
// known resolution instead of re-deriving one.
|
||||
val fixPointer = concept.fixPath?.let { " A prior validated fix modified: $it — mirror that resolution." }
|
||||
?: ""
|
||||
val content = "Known ${concept.gate} failure class (accreted from prior validated runs). " +
|
||||
concept.conceptText + fixPointer
|
||||
ContextEntry(
|
||||
id = ContextEntryId(UUID.randomUUID().toString()),
|
||||
layer = ContextLayer.L0,
|
||||
content = content,
|
||||
sourceType = "promotedConcept",
|
||||
sourceId = concept.classKey.ifBlank { concept.fingerprint },
|
||||
tokenEstimate = estimateTokens(content),
|
||||
role = EntryRole.SYSTEM,
|
||||
)
|
||||
}
|
||||
}
|
||||
|
||||
private const val MAX_PROMOTED_CONCEPTS = 3
|
||||
+7
-3
@@ -190,9 +190,13 @@ internal suspend fun SessionOrchestrator.buildClarificationAnswerEntries(session
|
||||
/**
|
||||
* If [stageId] just produced an LLM artifact carrying a non-empty `questions` array, park the
|
||||
* run: record the questions (invariant #9 — observed at parse time), await the operator's
|
||||
* answers, record them, and return true so the caller re-runs the stage with the answers in
|
||||
* context. Bounded by [MAX_CLARIFICATION_ROUNDS] so a stage that keeps re-asking eventually
|
||||
* proceeds. Returns false when there are no questions or the round budget is spent.
|
||||
* answers, and record them. The caller then ADVANCES to the next stage — the stage is not
|
||||
* re-run. The answers are session-wide events, injected into every later stage's L0 context
|
||||
* (see [buildClarificationAnswerEntries]), so the next stage acts on them directly; re-running
|
||||
* the questioning stage only restarts inference with no prior reasoning and makes it re-explore.
|
||||
* Bounded by [OrchestrationTuning.maxClarificationRounds] so retries can't re-park unboundedly.
|
||||
* Returns true when it parked and collected answers, false when there are no questions or the
|
||||
* round budget is spent.
|
||||
*/
|
||||
|
||||
internal suspend fun SessionOrchestrator.requestClarificationIfNeeded(
|
||||
|
||||
+55
-5
@@ -81,6 +81,30 @@ internal suspend fun SessionOrchestrator.executeStage(
|
||||
),
|
||||
)
|
||||
} ?: emptyList()
|
||||
// ponytail: env toggle so the prompt-audition harness (scripts/prompt-audition.sh, task #169) can
|
||||
// A/B the curated guidance block against a trimmed baseline without a rebuild. CORREX_STAGE_GUIDANCE=off
|
||||
// drops it; anything else (default) keeps it. Promote to a real config knob only if this outlives the audit.
|
||||
val operatingGuidance = if (System.getenv("CORREX_STAGE_GUIDANCE") == "off") emptyList() else listOf(
|
||||
ContextEntry(
|
||||
id = ContextEntryId(UUID.randomUUID().toString()),
|
||||
layer = ContextLayer.L0,
|
||||
content = CURATED_STAGE_OPERATING_GUIDANCE,
|
||||
sourceType = "operatingGuidance",
|
||||
sourceId = "curated-v1",
|
||||
tokenEstimate = estimateTokens(CURATED_STAGE_OPERATING_GUIDANCE),
|
||||
role = EntryRole.SYSTEM,
|
||||
),
|
||||
)
|
||||
// Capability accretion (design 2026-07-12-acr-concept-compiler.md): deterministically inject the
|
||||
// validated failure→fix concepts this stage could act on, so a known resolution is delivered
|
||||
// BEFORE the stage re-derives it. Primary channel; L3 remains the instance-recall fallback.
|
||||
val promotedConcepts = promotedConceptEntries(stageConfig)
|
||||
// Positive-pattern accretion (design 2026-07-12 §"broaden beyond failure→fix"): show the architect a
|
||||
// prior successful plan shape for a similar intent so it plans from a validated decomposition, not zero.
|
||||
val successfulPlanShapes = successfulPlanShapeEntries(sessionId, stageConfig)
|
||||
// Known-good workspace invariant (design 2026-07-15 seam 2): tell the stage whether the last
|
||||
// green build is still valid for the current workspace state, or stale and needing re-verification.
|
||||
val verifiedBaseline = verifiedBaselineEntries(sessionId)
|
||||
// A stage re-entered to repair a gate failure has its own (often generative/"scaffold") prompt
|
||||
// SUPPRESSED: that mandate is what drove it to overwrite real files with stubs on re-entry. The
|
||||
// recovery-ticket entry (buildRecoveryTicketEntry) is the sole mandate here — it already carries
|
||||
@@ -205,6 +229,8 @@ internal suspend fun SessionOrchestrator.executeStage(
|
||||
val agentInstructionsEntries = emptyList<ContextEntry>()
|
||||
val retryFeedbackEntries = buildRetryFeedbackEntry(sessionEvents, stageId)
|
||||
?.let { listOf(it) } ?: emptyList()
|
||||
val groundingFeedbackEntries = buildGroundingFeedbackEntry(sessionEvents, stageId)
|
||||
?.let { listOf(it) } ?: emptyList()
|
||||
val recoveryTicketEntries = buildRecoveryTicketEntry(sessionEvents, stageId)
|
||||
?.let { listOf(it) } ?: emptyList()
|
||||
val vocabularyEntries = artifactKindRegistry
|
||||
@@ -239,10 +265,11 @@ internal suspend fun SessionOrchestrator.executeStage(
|
||||
?.let { buildRemainingDeltaEntry(contractFailureItems(it)) }
|
||||
?.let { listOf(it) } ?: emptyList()
|
||||
var accumulatedEntries = stampBuckets(
|
||||
systemPrompt + intentEntries + profileEntries + projectProfileEntries + agentInstructionsEntries +
|
||||
systemPrompt + operatingGuidance + promotedConcepts + successfulPlanShapes + verifiedBaseline + intentEntries + profileEntries + projectProfileEntries + agentInstructionsEntries +
|
||||
journalEntries + repoMapEntries + claimedTaskEntries +
|
||||
needsEntries + schemaEntries + vocabularyEntries + promptEntries + steeringEntries +
|
||||
clarificationEntries + retryFeedbackEntries + recoveryTicketEntries + remainingDeltaEntries,
|
||||
clarificationEntries + retryFeedbackEntries + groundingFeedbackEntries + recoveryTicketEntries +
|
||||
remainingDeltaEntries,
|
||||
)
|
||||
val contextPack = runCatching {
|
||||
contextPackBuilder.build(
|
||||
@@ -350,13 +377,30 @@ internal suspend fun SessionOrchestrator.executeStage(
|
||||
continue
|
||||
}
|
||||
// emit_artifact is a meta-tool: the LLM calls it with the artifact's fields as arguments.
|
||||
// Capture those arguments as the artifact content and exit the loop straight to validation
|
||||
// (the post-loop capture honours this override instead of the empty assistant text).
|
||||
// Validate those arguments INLINE, like any other tool call: a valid artifact captures and
|
||||
// exits the loop; an invalid one is handed straight back into the SAME conversation as a
|
||||
// tool-result error, so the model fixes it with its full context (and CoT) intact. Breaking
|
||||
// the loop on a bad artifact would instead drop into a cold repair/retry that re-explores
|
||||
// from scratch and tends to re-make the identical schema mistake (2026-07-18).
|
||||
val emitCall = inferenceResult.response.toolCalls.firstOrNull { it.function.name == EMIT_ARTIFACT_TOOL }
|
||||
if (emitCall != null && llmEmittedSlots.isNotEmpty()) {
|
||||
llmArtifactOverride = emitCall.function.arguments
|
||||
val emitSlot = llmEmittedSlots.first()
|
||||
when (val res = artifactExtractionPipeline.run(emitCall.function.arguments, emitSlot.kind.deriveJsonSchema())) {
|
||||
is ArtifactExtractionPipeline.ExtractionResult.Resolved -> {
|
||||
llmArtifactOverride = res.canonicalJson.toString()
|
||||
break
|
||||
}
|
||||
is ArtifactExtractionPipeline.ExtractionResult.Unresolved -> {
|
||||
inferenceResult = pushBack(
|
||||
"ERROR: your emit_artifact call for '${emitSlot.name.value}' did not match the " +
|
||||
"schema: ${res.detail}. Call emit_artifact again with only that corrected. Every " +
|
||||
"field must sit at the level the schema defines — do not nest a top-level field " +
|
||||
"(e.g. ready, questions) inside another object.",
|
||||
)
|
||||
continue
|
||||
}
|
||||
}
|
||||
}
|
||||
// stage_complete is a meta-tool: the LLM calls it to signal the stage's goal is met.
|
||||
// Skip tool dispatch — the loop exits and normal validation/transition follows
|
||||
// (emitToolArtifacts + verifyProduces run on the success path after the loop).
|
||||
@@ -390,6 +434,12 @@ internal suspend fun SessionOrchestrator.executeStage(
|
||||
inferenceResult.response.toolCalls, stageConfig, effectives,
|
||||
approvalModeFor(session.state.boundProfile?.approvalMode),
|
||||
inferenceResult.response.reasoning)
|
||||
repeatedBuildCriticalReferenceBlock(sessionId, stageId)?.let { reason ->
|
||||
return StageExecutionResult.Failure(reason, retryable = true, gate = WORKSPACE_PRECONDITION_GATE)
|
||||
}
|
||||
repeatedToolFailureLoop(sessionId, stageId, tuning.stageFailureLoopLimit)?.let { reason ->
|
||||
return StageExecutionResult.Failure(reason, retryable = true, gate = STAGE_LOOP_BREAK_GATE)
|
||||
}
|
||||
val fatalEntry = toolEntries.firstOrNull { it.content.startsWith("FATAL:") }
|
||||
if (fatalEntry != null) {
|
||||
emitProcessResultEvents(sessionId, stageId, stageConfig)
|
||||
|
||||
+2
@@ -199,6 +199,7 @@ internal suspend fun SessionOrchestrator.runPostStageGates(
|
||||
{ runContractGate(sessionId, stageId, stageConfig, effectives) },
|
||||
{ runPlanCompileGate(sessionId, stageId, stageConfig) },
|
||||
{ runStaticAnalysis(sessionId, stageId, stageConfig, effectives) },
|
||||
{ runLspDiagnostics(sessionId, stageId, stageConfig, effectives) },
|
||||
{ runExecutionGate(sessionId, stageId, stageConfig, effectives, profileCommands) },
|
||||
{ runReviewGate(sessionId, stageId, stageConfig, effectives) },
|
||||
)
|
||||
@@ -258,6 +259,7 @@ internal suspend fun SessionOrchestrator.evaluateStageContract(
|
||||
layer = a.layer.name,
|
||||
evaluator = a.evaluator.name,
|
||||
passed = v.passed,
|
||||
skipped = v.skipped,
|
||||
evidence = v.evidence.takeLast(CONTRACT_EVIDENCE_CAP),
|
||||
)
|
||||
}
|
||||
|
||||
+62
-1
@@ -5,6 +5,7 @@ import com.correx.core.events.events.ReviewVerdict
|
||||
import com.correx.core.events.events.ArtifactCreatedEvent
|
||||
import com.correx.core.events.events.StaticAnalysisCompletedEvent
|
||||
import com.correx.core.events.events.StaticAnalysisFinding
|
||||
import com.correx.core.events.events.LspDiagnosticsCompletedEvent
|
||||
import com.correx.core.events.events.ArtifactValidatedEvent
|
||||
import com.correx.core.events.events.ArtifactValidatingEvent
|
||||
import com.correx.core.events.types.SessionId
|
||||
@@ -66,6 +67,55 @@ internal suspend fun SessionOrchestrator.runStaticAnalysis(
|
||||
)
|
||||
}
|
||||
|
||||
@Suppress("ReturnCount")
|
||||
internal suspend fun SessionOrchestrator.runLspDiagnostics(
|
||||
sessionId: SessionId,
|
||||
stageId: StageId,
|
||||
stageConfig: StageConfig,
|
||||
effectives: RunEffectives,
|
||||
): StageExecutionResult {
|
||||
val runner = lspDiagnosticsRunner ?: return StageExecutionResult.Success(emptyList())
|
||||
val workspaceRoot = effectives.policy?.workspaceRoot ?: return StageExecutionResult.Success(emptyList())
|
||||
val stagePaths = stageWrittenPaths(sessionId, stageId)
|
||||
val paths = if (stagePaths.isNotEmpty()) {
|
||||
stagePaths
|
||||
} else if (stageConfig.autoBuildGate) {
|
||||
sessionWrittenPaths(sessionId)
|
||||
} else {
|
||||
emptyList()
|
||||
}
|
||||
if (paths.isEmpty()) return StageExecutionResult.Success(emptyList())
|
||||
|
||||
val result = runner.pull(LspDiagnosticsRequest(workspaceRoot, paths))
|
||||
val plannedButUnwritten = stageConfig.writeManifest.filterNot { it in paths }
|
||||
val diagnostics = result.diagnostics.filter { diagnostic ->
|
||||
diagnostic.path in paths && plannedButUnwritten.none { planned ->
|
||||
diagnostic.message.contains(planned.substringAfterLast('/'), ignoreCase = true)
|
||||
}
|
||||
}
|
||||
emit(
|
||||
sessionId,
|
||||
LspDiagnosticsCompletedEvent(sessionId, stageId, result.server, diagnostics, result.skippedReason),
|
||||
)
|
||||
val errors = diagnostics.filter { it.severity.equals("error", ignoreCase = true) }
|
||||
if (errors.isEmpty()) return StageExecutionResult.Success(emptyList())
|
||||
val detail = errors.joinToString("\n") {
|
||||
"- ${it.path}:${it.line + 1}:${it.character + 1} ${it.code.orEmpty()} ${it.message}".trim()
|
||||
}
|
||||
return StageExecutionResult.Failure(
|
||||
"stage ${stageId.value} has LSP diagnostics in files it wrote. Fix these before proceeding:\n$detail",
|
||||
retryable = true,
|
||||
gate = "lsp_diagnostics",
|
||||
)
|
||||
}
|
||||
|
||||
internal fun SessionOrchestrator.sessionWrittenPaths(sessionId: SessionId): List<String> =
|
||||
eventStore.read(sessionId)
|
||||
.mapNotNull { it.payload as? com.correx.core.events.events.FileWrittenEvent }
|
||||
.filter { it.postImageHash != null }
|
||||
.map { it.path }
|
||||
.distinct()
|
||||
|
||||
/**
|
||||
* Gate 4 — execution (staged-verification §1/§2). A stage's [StageConfig.buildExpectation]
|
||||
* (none/module/project/tests) resolves to the bound project profile's typecheck/build/test
|
||||
@@ -76,6 +126,7 @@ internal suspend fun SessionOrchestrator.runStaticAnalysis(
|
||||
* [StaticAnalysisCompletedEvent], invariant #9, so replay never re-runs it).
|
||||
*/
|
||||
|
||||
@Suppress("ReturnCount")
|
||||
internal suspend fun SessionOrchestrator.runExecutionGate(
|
||||
sessionId: SessionId,
|
||||
stageId: StageId,
|
||||
@@ -93,6 +144,11 @@ internal suspend fun SessionOrchestrator.runExecutionGate(
|
||||
stageConfig.autoBuildGate && sessionProducedBuildTarget(sessionId) -> BuildExpectation.PROJECT
|
||||
else -> null
|
||||
}
|
||||
// LSP pull diagnostics are the compiler-front-end/typecheck gate. Keep PROJECT bundlers and
|
||||
// TESTS as real commands, but do not invoke the profile's flat `typecheck` alias as well.
|
||||
if (expectation == BuildExpectation.MODULE && lspDiagnosticsRunner != null) {
|
||||
return StageExecutionResult.Success(emptyList())
|
||||
}
|
||||
val alias = expectation?.commandAlias ?: return StageExecutionResult.Success(emptyList())
|
||||
val runner = staticAnalysisRunner
|
||||
val workspaceRoot = effectives.policy?.workspaceRoot
|
||||
@@ -112,7 +168,12 @@ internal suspend fun SessionOrchestrator.runExecutionGate(
|
||||
val run = runner.run(workspaceRoot, command)
|
||||
val finding = StaticAnalysisFinding(command, run.exitCode, run.output.takeLast(STATIC_ANALYSIS_SUMMARY_CAP))
|
||||
emit(sessionId, StaticAnalysisCompletedEvent(sessionId, stageId, listOf(finding)))
|
||||
if (finding.clean) return StageExecutionResult.Success(emptyList())
|
||||
if (finding.clean) {
|
||||
// Known-good workspace invariant (design 2026-07-15 seam 2): bind this green result to the
|
||||
// workspace state key so the next stage can trust it only while the workspace is unchanged.
|
||||
recordWorkspaceVerification(sessionId, stageId, expectation, command, passed = true)
|
||||
return StageExecutionResult.Success(emptyList())
|
||||
}
|
||||
|
||||
log.warn(
|
||||
"[Orchestrator] execution gate failed session={} stage={} expectation={} command={}",
|
||||
|
||||
+108
@@ -0,0 +1,108 @@
|
||||
@file:Suppress("MatchingDeclarationName") // SessionOrchestrator* extension group, not a single-class file.
|
||||
|
||||
package com.correx.core.kernel.orchestration
|
||||
|
||||
import com.correx.core.context.model.ContextEntry
|
||||
import com.correx.core.context.model.ContextLayer
|
||||
import com.correx.core.context.model.EntryRole
|
||||
import com.correx.core.events.events.ExecutionPlanLockedEvent
|
||||
import com.correx.core.events.events.InitialIntentEvent
|
||||
import com.correx.core.events.events.StoredEvent
|
||||
import com.correx.core.events.events.WorkflowCompletedEvent
|
||||
import com.correx.core.events.types.ContextEntryId
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.transitions.graph.StageConfig
|
||||
import java.util.UUID
|
||||
|
||||
/**
|
||||
* Positive-pattern accretion (design 2026-07-12-acr-concept-compiler.md §"Broaden beyond failure→fix"):
|
||||
* the failure→fix rail learns from what BROKE; this learns from what WORKED. When the architect is about
|
||||
* to plan, it is shown the plan SHAPE (stage-id sequence) of a prior run whose intent resembled this
|
||||
* one and that actually completed — so run N+1 starts from a decomposition already validated by run N,
|
||||
* instead of re-deriving structure from zero every time.
|
||||
*
|
||||
* Fully deterministic (invariants #8/#9): a pure fold over recorded events (initial intent, locked plan,
|
||||
* workflow completion) across all sessions. Intent resemblance is a keyword Jaccard overlap — no LLM, no
|
||||
* embedder — so it replays identically. Advisory only: it injects a reference shape as SYSTEM context;
|
||||
* the architect still authors the plan (invariant #3 LLM-proposes/core-decides).
|
||||
*/
|
||||
|
||||
/** A completed run reduced to what a future planner can reuse: its intent keywords and plan shape. */
|
||||
internal data class SuccessfulPlanShape(
|
||||
val sessionId: String,
|
||||
val intentKeywords: Set<String>,
|
||||
val stageSequence: List<String>,
|
||||
)
|
||||
|
||||
/** Stopword-trimmed lowercase word set of an intent — the deterministic resemblance key. */
|
||||
internal fun intentKeywords(intent: String): Set<String> =
|
||||
intent.lowercase()
|
||||
.split(Regex("""[^a-z0-9]+"""))
|
||||
.filter { it.length > 2 && it !in INTENT_STOPWORDS }
|
||||
.toSet()
|
||||
|
||||
/** Jaccard overlap of two keyword sets — 0.0 when either is empty. */
|
||||
internal fun keywordOverlap(a: Set<String>, b: Set<String>): Double {
|
||||
if (a.isEmpty() || b.isEmpty()) return 0.0
|
||||
val inter = a.intersect(b).size.toDouble()
|
||||
return inter / a.union(b).size
|
||||
}
|
||||
|
||||
/**
|
||||
* Mine successful plan shapes from [events] (cross-session log). A session qualifies when its locked
|
||||
* plan's workflow later emits a [WorkflowCompletedEvent] for that SAME workflow id — i.e. the executed
|
||||
* plan (not just the planning phase) reached completion. [exclude] drops the current session so a run
|
||||
* never learns from itself.
|
||||
*/
|
||||
internal fun mineSuccessfulPlanShapes(events: List<StoredEvent>, exclude: String): List<SuccessfulPlanShape> {
|
||||
val intents = events.mapNotNull { it.payload as? InitialIntentEvent }.associate { it.sessionId.value to it.intent }
|
||||
val locked = events.mapNotNull { it.payload as? ExecutionPlanLockedEvent }
|
||||
val completedWorkflows = events.mapNotNull { it.payload as? WorkflowCompletedEvent }
|
||||
.map { it.sessionId.value to it.workflowId }.toSet()
|
||||
return locked.mapNotNull { plan ->
|
||||
val sid = plan.sessionId.value
|
||||
val intent = intents[sid] ?: return@mapNotNull null
|
||||
// The executed plan completed only if a completion for its OWN workflow id was recorded.
|
||||
if (sid == exclude || (sid to plan.workflowId) !in completedWorkflows) return@mapNotNull null
|
||||
SuccessfulPlanShape(sid, intentKeywords(intent), plan.stageIds)
|
||||
}
|
||||
}
|
||||
|
||||
/**
|
||||
* L0/SYSTEM entry naming the closest matching prior successful plan shape — but only for the PLANNING
|
||||
* stage (the one producing an `execution_plan`), and only when resemblance clears [MIN_INTENT_OVERLAP]
|
||||
* so an unrelated run's shape is not mistaken for guidance.
|
||||
*/
|
||||
internal suspend fun SessionOrchestrator.successfulPlanShapeEntries(
|
||||
sessionId: SessionId,
|
||||
stageConfig: StageConfig,
|
||||
): List<ContextEntry> {
|
||||
val isPlanningStage = stageConfig.produces.any { it.kind.id == "execution_plan" }
|
||||
if (!isPlanningStage) return emptyList()
|
||||
val here = initialIntent(sessionId)?.let(::intentKeywords).orEmpty()
|
||||
if (here.isEmpty()) return emptyList()
|
||||
val best = mineSuccessfulPlanShapes(eventStore.allEvents().toList(), exclude = sessionId.value)
|
||||
.map { it to keywordOverlap(here, it.intentKeywords) }
|
||||
.filter { it.second >= MIN_INTENT_OVERLAP }
|
||||
.maxByOrNull { it.second } ?: return emptyList()
|
||||
val content = "## A plan shape that worked before\nA prior run with a similar goal completed " +
|
||||
"successfully using this stage sequence — reuse its structure where it fits, adapt where the " +
|
||||
"goal differs:\n${best.first.stageSequence.joinToString(" → ")}"
|
||||
return listOf(
|
||||
ContextEntry(
|
||||
id = ContextEntryId(UUID.randomUUID().toString()),
|
||||
layer = ContextLayer.L0,
|
||||
content = content,
|
||||
sourceType = "successfulPlanShape",
|
||||
sourceId = best.first.sessionId,
|
||||
tokenEstimate = estimateTokens(content),
|
||||
role = EntryRole.SYSTEM,
|
||||
),
|
||||
)
|
||||
}
|
||||
|
||||
private const val MIN_INTENT_OVERLAP = 0.34
|
||||
private val INTENT_STOPWORDS = setOf(
|
||||
"the", "and", "for", "with", "that", "this", "add", "make", "use", "using", "into", "from", "all",
|
||||
"new", "app", "should", "must", "will", "can", "its", "was", "are", "you", "your", "then",
|
||||
)
|
||||
+291
@@ -0,0 +1,291 @@
|
||||
package com.correx.core.kernel.orchestration
|
||||
|
||||
import com.correx.core.events.events.BuildPrerequisiteBootstrapAttemptedEvent
|
||||
import com.correx.core.events.events.ClarificationQuestion
|
||||
import com.correx.core.events.events.ClarificationRequestedEvent
|
||||
import com.correx.core.events.events.ClarificationAnswer
|
||||
import com.correx.core.events.events.ClarificationAnsweredEvent
|
||||
import com.correx.core.events.events.OrchestrationPausedEvent
|
||||
import com.correx.core.events.events.OrchestrationResumedEvent
|
||||
import com.correx.core.events.events.StoredEvent
|
||||
import com.correx.core.events.events.ToolCallAssessedEvent
|
||||
import com.correx.core.events.events.ToolExecutionFailedEvent
|
||||
import com.correx.core.events.events.ToolInvocationRequestedEvent
|
||||
import com.correx.core.events.orchestration.OrchestrationState
|
||||
import com.correx.core.events.risk.RiskAction
|
||||
import com.correx.core.events.types.ClarificationRequestId
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.events.types.StageId
|
||||
import com.correx.core.transitions.graph.StageConfig
|
||||
import kotlinx.coroutines.CompletableDeferred
|
||||
import java.nio.file.FileSystems
|
||||
import java.nio.file.Path
|
||||
import java.util.UUID
|
||||
|
||||
/**
|
||||
* Repeated attempts to read a missing build prerequisite are no longer mere ReAct noise. Once the
|
||||
* same build-critical path has been durably BLOCK'd three times *within the current bootstrap
|
||||
* window* (design 2026-07-15 §#163/#170), return a retryable gate failure so the orchestrator can
|
||||
* grant a bounded precondition-resolution turn (or route to a stage that can create the file).
|
||||
*
|
||||
* The window is scoped to events after the last [BuildPrerequisiteBootstrapAttemptedEvent] for this
|
||||
* stage: without that, the historical blocks that triggered the FIRST detection would re-trip the
|
||||
* gate on the very first round of the granted bootstrap turn, before the model ever gets to write
|
||||
* the file. Scoping resets the count so the bootstrap turn starts clean and only *new* blocks
|
||||
* (the model failed to create it) escalate.
|
||||
*/
|
||||
internal fun SessionOrchestrator.repeatedBuildCriticalReferenceBlock(
|
||||
sessionId: SessionId,
|
||||
stageId: StageId,
|
||||
): String? {
|
||||
val events = eventStore.read(sessionId)
|
||||
val windowStart = events
|
||||
.filter { (it.payload as? BuildPrerequisiteBootstrapAttemptedEvent)?.stageId == stageId }
|
||||
.maxOfOrNull { it.sequence } ?: Long.MIN_VALUE
|
||||
val windowed = events.filter { it.sequence > windowStart }
|
||||
val requests = windowed
|
||||
.mapNotNull { it.payload as? ToolInvocationRequestedEvent }
|
||||
.filter { it.stageId == stageId }
|
||||
.associateBy { it.invocationId }
|
||||
val paths = windowed
|
||||
.mapNotNull { it.payload as? ToolCallAssessedEvent }
|
||||
.filter { it.stageId == stageId && it.disposition == RiskAction.BLOCK }
|
||||
.filter { event -> event.issues.any { it.code == REFERENCE_EXISTS_CODE } }
|
||||
.mapNotNull { event -> requests[event.invocationId]?.request?.parameters?.get("path") as? String }
|
||||
.filter(::isBuildCriticalPath)
|
||||
val repeated = paths.groupingBy { it }.eachCount().entries
|
||||
.firstOrNull { it.value >= REFERENCE_EXISTS_REPEAT_LIMIT }
|
||||
?: return null
|
||||
return "stage ${stageId.value} repeatedly referenced missing build prerequisite '${repeated.key}' " +
|
||||
"(${repeated.value} blocked attempts). Create or repair the project setup before continuing."
|
||||
}
|
||||
|
||||
/**
|
||||
* Global backstop for a stage stuck retrying the *same* failing action (Vikunja #78). The existing
|
||||
* read-loop and rejection-loop breakers key on CONSECUTIVE rounds, so a single interleaved success
|
||||
* resets their counters — exactly what let the 2026-07-16 audition run-3 thrash `npm install` against
|
||||
* a hallucinated package across 57 inferences. This counts CUMULATIVELY per normalized failure
|
||||
* signature within the stage: once one signature has failed [limit] times, retrying it is provably
|
||||
* pointless, so return a retryable gate failure that the step handler routes straight to recovery.
|
||||
*
|
||||
* Pure fold over recorded events (replay-safe, invariants #8/#9). [ToolExecutionFailedEvent] carries
|
||||
* no stageId, so failures are correlated to the stage via their invocationId → the emitting
|
||||
* [ToolInvocationRequestedEvent] (which does).
|
||||
*
|
||||
* ponytail: cumulative over the whole stage, not windowed per re-entry — a break escalates to
|
||||
* recovery under a bounded budget, so an unfixable loop terminates rather than re-tripping forever.
|
||||
* Add a per-re-entry window only if a legitimate later attempt gets cut short.
|
||||
*/
|
||||
internal fun SessionOrchestrator.repeatedToolFailureLoop(
|
||||
sessionId: SessionId,
|
||||
stageId: StageId,
|
||||
limit: Int,
|
||||
): String? = detectRepeatedToolFailure(eventStore.read(sessionId), stageId, limit)
|
||||
|
||||
/** Pure core of [repeatedToolFailureLoop] — a fold over recorded events (unit-tested in isolation). */
|
||||
internal fun detectRepeatedToolFailure(
|
||||
events: List<StoredEvent>,
|
||||
stageId: StageId,
|
||||
limit: Int,
|
||||
): String? {
|
||||
val stageInvocations = events
|
||||
.mapNotNull { it.payload as? ToolInvocationRequestedEvent }
|
||||
.filter { it.stageId == stageId }
|
||||
.map { it.invocationId }
|
||||
.toSet()
|
||||
val repeated = events
|
||||
.mapNotNull { it.payload as? ToolExecutionFailedEvent }
|
||||
.filter { it.invocationId in stageInvocations }
|
||||
// Collapse to a stable signature so equivalent retries group together: drop digits (package
|
||||
// versions, ports, counts) and punctuation/paths, keep the tool name and alphabetic core.
|
||||
// `npm install @types/vite@4.0.0` 404 and `@types/vite@5` 404 map to the same signature.
|
||||
.groupingBy { failure ->
|
||||
failure.toolName + "|" + failure.reason.lowercase()
|
||||
.replace(Regex("[0-9]+"), " ")
|
||||
.replace(Regex("[^a-z ]+"), " ")
|
||||
.replace(Regex("\\s+"), " ")
|
||||
.trim()
|
||||
.take(FAILURE_SIGNATURE_PREFIX)
|
||||
}
|
||||
.eachCount().entries
|
||||
.firstOrNull { it.value >= limit }
|
||||
?: return null
|
||||
return "stage ${stageId.value} is stuck: the same tool failure recurred ${repeated.value} times " +
|
||||
"(${repeated.key}). Retrying it keeps failing — a materially different action is required."
|
||||
}
|
||||
|
||||
/**
|
||||
* Which bounded precondition-resolution path a repeated build-prerequisite block takes (design #170).
|
||||
* Pure over the three observable facts — deterministic/replay-safe, unit-tested in isolation.
|
||||
*/
|
||||
internal enum class PrerequisiteAction { BOOTSTRAP, ROUTE_TO_RECOVERY, CLARIFY, ESCALATE }
|
||||
|
||||
/**
|
||||
* - not writable → the stage can't create the file; route to a stage that can ([ROUTE_TO_RECOVERY]).
|
||||
* - writable but the path is outside the stage's declared scope → don't guess who owns project
|
||||
* setup, ask ([CLARIFY]).
|
||||
* - writable, in-scope, bootstrap budget left → grant the one dedicated turn ([BOOTSTRAP]).
|
||||
* - writable, in-scope, budget spent → the turn didn't clear it; escalate to recovery ([ESCALATE]).
|
||||
*/
|
||||
internal fun decidePrerequisiteAction(
|
||||
writable: Boolean,
|
||||
inScope: Boolean,
|
||||
bootstrapBudgetLeft: Boolean,
|
||||
): PrerequisiteAction = when {
|
||||
!writable -> PrerequisiteAction.ROUTE_TO_RECOVERY
|
||||
!inScope -> PrerequisiteAction.CLARIFY
|
||||
bootstrapBudgetLeft -> PrerequisiteAction.BOOTSTRAP
|
||||
else -> PrerequisiteAction.ESCALATE
|
||||
}
|
||||
|
||||
/** Extract the quoted build-prerequisite path from a [repeatedBuildCriticalReferenceBlock] reason. */
|
||||
internal fun buildPrerequisitePath(reason: String): String? =
|
||||
PREREQUISITE_PATH_RE.find(reason)?.groupValues?.get(1)
|
||||
|
||||
/**
|
||||
* Is [path] within this stage's declared territory? A stage with no declared scope (empty [touches]
|
||||
* and [writeManifest]) is unconstrained → owns everything → in-scope. Otherwise the path must match a
|
||||
* declared glob or be a concretely-declared file. Reused glob semantics from ManifestContainmentRule.
|
||||
*/
|
||||
internal fun pathInDeclaredScope(stage: StageConfig, path: String): Boolean {
|
||||
val globs = stage.touches + stage.writeManifest
|
||||
return globs.isEmpty() || // unconstrained stage owns everything
|
||||
path in stage.expectedFiles ||
|
||||
globs.any { FileSystems.getDefault().getPathMatcher("glob:$it").matches(Path.of(path)) }
|
||||
}
|
||||
|
||||
/** How many bootstrap turns this stage has already been granted (the separate one-shot budget). */
|
||||
internal fun bootstrapAttemptCount(events: List<StoredEvent>, stageId: StageId): Int =
|
||||
events.count { (it.payload as? BuildPrerequisiteBootstrapAttemptedEvent)?.stageId == stageId }
|
||||
|
||||
/**
|
||||
* What the step loop should do after a repeated build-prerequisite block on a writable-or-not stage.
|
||||
* [FallThrough] = not our special case (non-writable) — let the normal recovery routing handle it;
|
||||
* [Bootstrap] = re-run the stage this once (loop), the separate budget already charged;
|
||||
* [Done] = a terminal/routed [StepResult] to return.
|
||||
*/
|
||||
internal sealed interface PrerequisiteOutcome {
|
||||
data object Bootstrap : PrerequisiteOutcome
|
||||
data object FallThrough : PrerequisiteOutcome
|
||||
data class Done(val result: StepResult) : PrerequisiteOutcome
|
||||
}
|
||||
|
||||
/**
|
||||
* Decide and enact the bounded precondition-resolution path for a `workspace_precondition` failure,
|
||||
* WITHOUT touching the normal stage retry budget (design #170). Side effects (recording the bootstrap
|
||||
* grant, requesting clarification, routing to recovery) are performed here; the returned outcome tells
|
||||
* the step loop whether to loop, fall through, or return.
|
||||
*/
|
||||
internal suspend fun DefaultSessionOrchestrator.buildPrerequisiteDecision(
|
||||
ctx: EnrichedExecutionContext,
|
||||
stageId: StageId,
|
||||
failure: com.correx.core.transitions.execution.StageExecutionResult.Failure,
|
||||
state: OrchestrationState,
|
||||
): PrerequisiteOutcome {
|
||||
val stage = ctx.graph.stages[stageId]
|
||||
val path = buildPrerequisitePath(failure.reason)
|
||||
if (stage == null || path == null) return PrerequisiteOutcome.FallThrough
|
||||
val events = repositories.eventStore.read(ctx.sessionId)
|
||||
val action = decidePrerequisiteAction(
|
||||
writable = "file_write" in stage.allowedTools,
|
||||
inScope = pathInDeclaredScope(stage, path),
|
||||
bootstrapBudgetLeft = bootstrapAttemptCount(events, stageId) < BOOTSTRAP_BUDGET,
|
||||
)
|
||||
return when (action) {
|
||||
PrerequisiteAction.ROUTE_TO_RECOVERY -> PrerequisiteOutcome.FallThrough
|
||||
PrerequisiteAction.BOOTSTRAP -> {
|
||||
emit(
|
||||
ctx.sessionId,
|
||||
BuildPrerequisiteBootstrapAttemptedEvent(ctx.sessionId, stageId, path, failure.reason),
|
||||
)
|
||||
log.info(
|
||||
"[Orchestrator] granting build-prerequisite bootstrap turn session={} stage={} path={}",
|
||||
ctx.sessionId.value, stageId.value, path,
|
||||
)
|
||||
PrerequisiteOutcome.Bootstrap
|
||||
}
|
||||
PrerequisiteAction.CLARIFY -> requestBuildPrerequisiteClarification(ctx, stageId, path)
|
||||
PrerequisiteAction.ESCALATE -> PrerequisiteOutcome.Done(
|
||||
routeToRecovery(ctx, stageId, failure.gate, "file_write", failure.reason, state)
|
||||
?: StepResult.Terminal(
|
||||
failWorkflow(
|
||||
ctx.sessionId,
|
||||
stageId,
|
||||
"build prerequisite '$path' unresolved after bootstrap: ${failure.reason}",
|
||||
retryExhausted = true,
|
||||
),
|
||||
),
|
||||
)
|
||||
}
|
||||
}
|
||||
|
||||
/**
|
||||
* The missing prerequisite lies outside the writable stage's declared scope: ownership of project
|
||||
* setup is ambiguous, so record a clarification request and pause rather than guess (design #170
|
||||
* point 5). After the operator answers, loop to re-run the stage with the answer in context. Bounded
|
||||
* by [tuning].maxClarificationRounds; a spent budget fails the workflow rather than looping.
|
||||
*/
|
||||
private suspend fun DefaultSessionOrchestrator.requestBuildPrerequisiteClarification(
|
||||
ctx: EnrichedExecutionContext,
|
||||
stageId: StageId,
|
||||
path: String,
|
||||
): PrerequisiteOutcome {
|
||||
val priorRounds = repositories.eventStore.read(ctx.sessionId)
|
||||
.count { (it.payload as? ClarificationRequestedEvent)?.stageId == stageId }
|
||||
if (priorRounds >= tuning.maxClarificationRounds) {
|
||||
return PrerequisiteOutcome.Done(
|
||||
StepResult.Terminal(
|
||||
failWorkflow(
|
||||
ctx.sessionId,
|
||||
stageId,
|
||||
"build prerequisite '$path' is outside stage ${stageId.value}'s declared scope " +
|
||||
"and clarification budget is spent",
|
||||
retryExhausted = true,
|
||||
),
|
||||
),
|
||||
)
|
||||
}
|
||||
val requestId = ClarificationRequestId(UUID.randomUUID().toString())
|
||||
val deferred = CompletableDeferred<List<ClarificationAnswer>>()
|
||||
pendingClarifications[requestId] = deferred
|
||||
emit(ctx.sessionId, OrchestrationPausedEvent(ctx.sessionId, stageId, "CLARIFICATION_PENDING"))
|
||||
emit(
|
||||
ctx.sessionId,
|
||||
ClarificationRequestedEvent(
|
||||
requestId = requestId,
|
||||
sessionId = ctx.sessionId,
|
||||
stageId = stageId,
|
||||
questions = listOf(
|
||||
ClarificationQuestion(
|
||||
id = "build_prerequisite",
|
||||
prompt = "Stage ${stageId.value} is blocked on a missing build prerequisite " +
|
||||
"'$path' that is outside its declared scope. Should this stage create it, or " +
|
||||
"does another stage own project setup?",
|
||||
header = "Missing setup",
|
||||
),
|
||||
),
|
||||
),
|
||||
)
|
||||
return try {
|
||||
val answers = deferred.await()
|
||||
emit(ctx.sessionId, ClarificationAnsweredEvent(requestId, ctx.sessionId, stageId, answers))
|
||||
emit(ctx.sessionId, OrchestrationResumedEvent(ctx.sessionId, stageId))
|
||||
PrerequisiteOutcome.Bootstrap
|
||||
} finally {
|
||||
pendingClarifications.remove(requestId)
|
||||
}
|
||||
}
|
||||
|
||||
private fun isBuildCriticalPath(path: String): Boolean {
|
||||
val name = path.substringAfterLast('/').lowercase()
|
||||
return name in BUILD_PREREQUISITE_FILENAMES
|
||||
}
|
||||
|
||||
// At most one dedicated bootstrap turn per stage (design #170 acceptance: "at most one").
|
||||
private const val BOOTSTRAP_BUDGET = 1
|
||||
private val PREREQUISITE_PATH_RE = Regex("""missing build prerequisite '([^']+)'""")
|
||||
private const val REFERENCE_EXISTS_REPEAT_LIMIT = 3
|
||||
private const val FAILURE_SIGNATURE_PREFIX = 80
|
||||
private val BUILD_PREREQUISITE_FILENAMES = setOf(
|
||||
"package.json", "tsconfig.json", "vite.config.ts", "build.gradle", "build.gradle.kts", "pom.xml",
|
||||
)
|
||||
+12
-5
@@ -85,7 +85,6 @@ internal fun SessionOrchestrator.toolArgsHint(tool: Tool?): String =
|
||||
"\nAccepted parameters for '${it.name}': ${it.parametersSchema}"
|
||||
}.orEmpty()
|
||||
|
||||
|
||||
/**
|
||||
* Render a tool result into the consistently-framed, bounded text the model sees. Success output
|
||||
* is run through the tool's [ToolOutputCompressor], then framed with a uniform `[tool exit=N]`
|
||||
@@ -99,20 +98,28 @@ internal fun SessionOrchestrator.toolArgsHint(tool: Tool?): String =
|
||||
internal suspend fun SessionOrchestrator.renderToolResult(toolName: String, tool: Tool?, result: ToolResult): RenderedToolResult =
|
||||
when (result) {
|
||||
is ToolResult.Failure -> RenderedToolResult(
|
||||
if (!result.recoverable) "FATAL: ${result.reason}" else "ERROR: ${result.reason}${toolArgsHint(tool)}",
|
||||
if (!result.recoverable) {
|
||||
"FATAL: ${result.reason}"
|
||||
} else {
|
||||
"ERROR: ${result.reason}${toolArgsHint(tool)}${packageNotFoundAdvisory(result.reason)}"
|
||||
},
|
||||
null,
|
||||
)
|
||||
is ToolResult.Success -> {
|
||||
val compressed = tool?.outputCompressor?.compress(result.output, ToolOutputContext(result.exitCode))
|
||||
?: result.output
|
||||
val header = "[$toolName exit=${result.exitCode}]"
|
||||
if (compressed.length <= TOOL_RESULT_MAX_CHARS) {
|
||||
RenderedToolResult("$header\n$compressed", null)
|
||||
// A package-install 404 usually surfaces as a nonzero-exit Success (the shell ran; the
|
||||
// installer failed). Parse it deterministically and name the offending manifest entry so
|
||||
// the model edits the manifest instead of thrashing the installer (Vikunja #192).
|
||||
val advisory = if (result.exitCode != 0) packageNotFoundAdvisory(result.output) else ""
|
||||
if (compressed.length + advisory.length <= TOOL_RESULT_MAX_CHARS) {
|
||||
RenderedToolResult("$header\n$compressed$advisory", null)
|
||||
} else {
|
||||
// Spill the full RAW output (most complete) so retrieval returns everything, not the
|
||||
// already-compressed preview the model saw.
|
||||
val ref = artifactStore.put(result.output.toByteArray()).value
|
||||
RenderedToolResult(frameTruncatedToolResult(header, compressed, ref), ref)
|
||||
RenderedToolResult(frameTruncatedToolResult(header, compressed, ref) + advisory, ref)
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
+92
@@ -0,0 +1,92 @@
|
||||
package com.correx.core.kernel.orchestration
|
||||
|
||||
import com.correx.core.context.model.ContextEntry
|
||||
import com.correx.core.context.model.ContextLayer
|
||||
import com.correx.core.context.model.EntryRole
|
||||
import com.correx.core.events.events.FileWrittenEvent
|
||||
import com.correx.core.events.events.StoredEvent
|
||||
import com.correx.core.events.events.WorkspaceVerificationObservedEvent
|
||||
import com.correx.core.events.types.ContextEntryId
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.events.types.StageId
|
||||
import com.correx.core.transitions.graph.BuildExpectation
|
||||
import java.util.UUID
|
||||
|
||||
/**
|
||||
* Replay-safe workspace state key (design 2026-07-15 seam 2). The workspace's verified identity is
|
||||
* the folded FileWritten manifest — each path mapped to its latest recorded post-image hash. Hashing
|
||||
* the sorted map yields a key that changes iff a file changed, so a verification observation stamped
|
||||
* with this key is invalidated automatically by any later write. Derived purely from recorded events
|
||||
* (never rescans the filesystem), so replay reproduces the same key (invariants #8/#9).
|
||||
*/
|
||||
internal fun workspaceStateKey(events: List<StoredEvent>): String {
|
||||
val latest = linkedMapOf<String, String>()
|
||||
events.mapNotNull { it.payload as? FileWrittenEvent }
|
||||
.forEach { fw -> latest[fw.path] = fw.postImageHash ?: "" }
|
||||
val canonical = latest.entries.sortedBy { it.key }.joinToString("\n") { "${it.key}=${it.value}" }
|
||||
return Integer.toHexString(canonical.hashCode())
|
||||
}
|
||||
|
||||
/**
|
||||
* Record the known-good verification observation for a passing build gate, binding the result to the
|
||||
* current [workspaceStateKey]. Called from the execution gate on a clean run so the next stage can
|
||||
* tell a still-valid baseline from a stale one. Emits nothing for [BuildExpectation.NONE] (no build
|
||||
* claim manufactured — spec: a docs-only/no-write stage does not fabricate a compiler assertion).
|
||||
*/
|
||||
internal suspend fun SessionOrchestrator.recordWorkspaceVerification(
|
||||
sessionId: SessionId,
|
||||
stageId: StageId,
|
||||
expectation: BuildExpectation,
|
||||
command: String,
|
||||
passed: Boolean,
|
||||
) {
|
||||
val events = eventStore.read(sessionId)
|
||||
emit(
|
||||
sessionId,
|
||||
WorkspaceVerificationObservedEvent(
|
||||
sessionId = sessionId,
|
||||
stageId = stageId,
|
||||
stateKey = workspaceStateKey(events),
|
||||
expectation = expectation.name,
|
||||
command = command,
|
||||
passed = passed,
|
||||
changedPaths = stageWrittenPaths(sessionId, stageId),
|
||||
),
|
||||
)
|
||||
}
|
||||
|
||||
/**
|
||||
* The `verified baseline` L0 entry for the next implementation stage (design 2026-07-15 seam 2). If
|
||||
* the latest passing [WorkspaceVerificationObservedEvent]'s state key still equals the CURRENT state
|
||||
* key, the workspace is known-good and the entry states the verified command + changed paths. If the
|
||||
* workspace changed since (key mismatch), the entry says the baseline is stale and the stage must
|
||||
* re-verify — it never claims a skipped compiler assertion passed. Empty when nothing has verified yet.
|
||||
*/
|
||||
internal suspend fun SessionOrchestrator.verifiedBaselineEntries(sessionId: SessionId): List<ContextEntry> {
|
||||
val events = eventStore.read(sessionId)
|
||||
val lastPass = events.mapNotNull { it.payload as? WorkspaceVerificationObservedEvent }
|
||||
.lastOrNull { it.passed } ?: return emptyList()
|
||||
val current = workspaceStateKey(events)
|
||||
val fresh = current == lastPass.stateKey
|
||||
val content = if (fresh) {
|
||||
"## Verified baseline (known-good)\nThe workspace passed `${lastPass.command}` " +
|
||||
"(${lastPass.expectation}) at the current state. Build/typecheck is green as of these paths: " +
|
||||
"${lastPass.changedPaths.joinToString(", ").ifBlank { "(no declared write paths)" }}. " +
|
||||
"Build on it; do not re-derive what already compiles."
|
||||
} else {
|
||||
"## Verified baseline (STALE)\nThe last green verification (`${lastPass.command}`) was for an " +
|
||||
"earlier workspace state; files changed since, so it is no longer authoritative. Re-run the " +
|
||||
"build gate before treating the workspace as known-good."
|
||||
}
|
||||
return listOf(
|
||||
ContextEntry(
|
||||
id = ContextEntryId(UUID.randomUUID().toString()),
|
||||
layer = ContextLayer.L0,
|
||||
content = content,
|
||||
sourceType = "verifiedBaseline",
|
||||
sourceId = lastPass.stateKey,
|
||||
tokenEstimate = estimateTokens(content),
|
||||
role = EntryRole.SYSTEM,
|
||||
),
|
||||
)
|
||||
}
|
||||
+7
-2
@@ -69,13 +69,18 @@ internal suspend fun SessionOrchestrator.advanceStage(
|
||||
|
||||
// --- terminal state helpers ---
|
||||
|
||||
internal suspend fun SessionOrchestrator.emitWorkflowStarted(sessionId: SessionId, graph: WorkflowGraph, config: OrchestrationConfig) {
|
||||
internal suspend fun SessionOrchestrator.emitWorkflowStarted(
|
||||
sessionId: SessionId,
|
||||
graph: WorkflowGraph,
|
||||
config: OrchestrationConfig,
|
||||
startStage: StageId = graph.start,
|
||||
) {
|
||||
emit(
|
||||
sessionId,
|
||||
WorkflowStartedEvent(
|
||||
sessionId = sessionId,
|
||||
workflowId = graph.id,
|
||||
startStageId = graph.start,
|
||||
startStageId = startStage,
|
||||
retryPolicy = config.retryPolicy,
|
||||
),
|
||||
)
|
||||
|
||||
+3
-2
@@ -48,7 +48,9 @@ class TierContextSummarizer(
|
||||
}
|
||||
val summaryText = summarize(prompt)
|
||||
val summaryArtifactId = artifactStore.put(summaryText.toByteArray(Charsets.UTF_8))
|
||||
artifactStore.flushBefore {
|
||||
// Emit directly, NOT inside flushBefore { }: append() already fsyncs artifacts before it
|
||||
// persists the event, so wrapping the emit here re-acquires the (non-reentrant) artifact
|
||||
// Mutex that flushBefore already holds → self-deadlock (same bug as JournalCompactionService).
|
||||
emit(
|
||||
ContextSummarizedEvent(
|
||||
sessionId = sessionId,
|
||||
@@ -58,7 +60,6 @@ class TierContextSummarizer(
|
||||
entriesOmittedCount = freeformEntries.size,
|
||||
),
|
||||
)
|
||||
}
|
||||
return true
|
||||
}
|
||||
}
|
||||
|
||||
+36
@@ -0,0 +1,36 @@
|
||||
package com.correx.core.kernel.orchestration
|
||||
|
||||
/**
|
||||
* Deterministic recovery evidence for an unambiguous package-not-found (Vikunja #192). A registry
|
||||
* 404 means the dependency does not exist — retrying the installer, pinning a version, or switching
|
||||
* package managers cannot fix it (the 2026-07-16 audition burned 26 inferences doing exactly that).
|
||||
* Parse the offending name out of npm/yarn/pnpm output and hand back a directive that points at the
|
||||
* *manifest*, not the installer. Empty string when no 404 is detected, so callers concatenate
|
||||
* unconditionally. Pure over the tool output (already recorded on the ToolReceipt) — no new event.
|
||||
*/
|
||||
internal fun packageNotFoundAdvisory(output: String): String {
|
||||
val pkg = PACKAGE_NOT_FOUND_PATTERNS.firstNotNullOfOrNull { it.find(output)?.groupValues?.get(1) }
|
||||
?.replace("%2f", "/", ignoreCase = true) // npm URL-encodes the scope slash
|
||||
?.trim()
|
||||
?.takeIf { it.isNotEmpty() }
|
||||
?: return ""
|
||||
// Strip a trailing @version so the name matches the manifest key.
|
||||
val name = if (pkg.startsWith("@")) {
|
||||
"@" + pkg.removePrefix("@").substringBefore('@')
|
||||
} else {
|
||||
pkg.substringBefore('@')
|
||||
}
|
||||
return "\nPACKAGE_NOT_FOUND: '$name' does not exist in the registry (404). Do NOT retry the " +
|
||||
"installer, pin a version, or switch package managers — none can create a nonexistent " +
|
||||
"package. Edit the manifest (e.g. package.json) to remove or correct '$name', then reinstall."
|
||||
}
|
||||
|
||||
// Registry-404 shapes across npm/yarn/pnpm. Group 1 is the offending package spec.
|
||||
// npm modern: npm error 404 '@types/vite@^4.0.0' is not in this registry.
|
||||
// npm/GET url: npm error 404 Not Found - GET https://registry.npmjs.org/@types%2fvite - Not found
|
||||
// yarn: error ... https://registry.yarnpkg.com/@types%2fvite: Not found
|
||||
// pnpm: ERR_PNPM_FETCH_404 ... GET https://registry.npmjs.org/@types%2fvite: Not Found - 404
|
||||
private val PACKAGE_NOT_FOUND_PATTERNS = listOf(
|
||||
Regex("""404[^\n']*'([^'\n]+)'"""),
|
||||
Regex("""404[^\n]*?registry\.\S+?/(@?[\w.%-]+(?:/[\w.%-]+)?)"""),
|
||||
)
|
||||
+176
@@ -0,0 +1,176 @@
|
||||
package com.correx.core.kernel.concept
|
||||
|
||||
import com.correx.core.events.events.ConceptPromotedEvent
|
||||
import com.correx.core.events.events.EventMetadata
|
||||
import com.correx.core.events.events.EventPayload
|
||||
import com.correx.core.events.events.FileWrittenEvent
|
||||
import com.correx.core.events.events.RetryAttemptedEvent
|
||||
import com.correx.core.events.events.StageCompletedEvent
|
||||
import com.correx.core.events.events.StageFailedEvent
|
||||
import com.correx.core.events.events.StoredEvent
|
||||
import com.correx.core.events.events.WorkflowFailedEvent
|
||||
import com.correx.core.events.types.EventId
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.events.types.StageId
|
||||
import com.correx.core.events.types.ToolInvocationId
|
||||
import com.correx.core.events.types.TransitionId
|
||||
import kotlinx.datetime.Instant
|
||||
import org.junit.jupiter.api.Assertions.assertEquals
|
||||
import org.junit.jupiter.api.Assertions.assertTrue
|
||||
import org.junit.jupiter.api.Test
|
||||
|
||||
class ConceptCompilerProjectionTest {
|
||||
|
||||
private val projection = ConceptCompilerProjection()
|
||||
private var seq = 0L
|
||||
|
||||
private fun stored(payload: EventPayload, session: String = "s1") = StoredEvent(
|
||||
metadata = EventMetadata(
|
||||
eventId = EventId("e${seq++}"),
|
||||
sessionId = SessionId(session),
|
||||
timestamp = Instant.parse("2026-01-01T00:00:00Z"),
|
||||
schemaVersion = 1,
|
||||
causationId = null,
|
||||
correlationId = null,
|
||||
),
|
||||
sequence = seq,
|
||||
sessionSequence = seq,
|
||||
payload = payload,
|
||||
)
|
||||
|
||||
private fun retry(fp: String, stage: String = "impl", session: String = "s1", reason: String = "boom\ndetail") =
|
||||
stored(
|
||||
RetryAttemptedEvent(
|
||||
sessionId = SessionId(session),
|
||||
stageId = StageId(stage),
|
||||
attemptNumber = 1,
|
||||
maxAttempts = 3,
|
||||
failureReason = reason,
|
||||
gate = "lint",
|
||||
fingerprint = fp,
|
||||
),
|
||||
session,
|
||||
)
|
||||
|
||||
private fun completed(stage: String = "impl", session: String = "s1") =
|
||||
stored(StageCompletedEvent(SessionId(session), StageId(stage), TransitionId("t")), session)
|
||||
|
||||
private fun failed(stage: String = "impl", session: String = "s1") =
|
||||
stored(StageFailedEvent(SessionId(session), StageId(stage), TransitionId("t"), "x"), session)
|
||||
|
||||
private fun wrote(path: String, hash: String? = "cas1", session: String = "s1") =
|
||||
stored(
|
||||
FileWrittenEvent(
|
||||
invocationId = ToolInvocationId("inv"),
|
||||
sessionId = SessionId(session),
|
||||
path = path,
|
||||
postImageHash = hash,
|
||||
preExisted = true,
|
||||
timestampMs = 1L,
|
||||
),
|
||||
session,
|
||||
)
|
||||
|
||||
private fun fold(events: List<StoredEvent>) =
|
||||
events.fold(projection.initial(), projection::apply)
|
||||
|
||||
// All helpers default to reason "boom\ndetail" on gate "lint" → the single class key "lint:boom".
|
||||
private val ConceptCompilerState.only get() = clusters.values.single()
|
||||
|
||||
@Test
|
||||
fun `retry then StageCompleted counts one validated fix`() {
|
||||
val state = fold(listOf(retry("fp1"), completed()))
|
||||
assertEquals(1, state.only.validatedFixes)
|
||||
assertTrue(state.promotable().isEmpty())
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `three cross-session validated fixes cross the threshold`() {
|
||||
val state = fold(
|
||||
listOf(
|
||||
retry("fp1", session = "sa"), completed(session = "sa"),
|
||||
retry("fp1", session = "sb"), completed(session = "sb"),
|
||||
retry("fp1", session = "sc"), completed(session = "sc"),
|
||||
),
|
||||
)
|
||||
assertEquals(3, state.only.validatedFixes)
|
||||
assertEquals(listOf("lint:boom"), state.promotable().map { it.classKey })
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `distinct fingerprints of the same failure class aggregate into one concept`() {
|
||||
// Same normalized signature, different volatile tokens (paths/line numbers) → one class key.
|
||||
val state = fold(
|
||||
listOf(
|
||||
retry("fpA", session = "sa", reason = "TS2322 in 'src/App.tsx:12'"), completed(session = "sa"),
|
||||
retry("fpB", session = "sb", reason = "TS2322 in 'src/Nav.tsx:88'"), completed(session = "sb"),
|
||||
retry("fpC", session = "sc", reason = "TS2322 in 'src/Home.tsx:5'"), completed(session = "sc"),
|
||||
),
|
||||
)
|
||||
assertEquals(1, state.clusters.size)
|
||||
assertEquals(3, state.only.validatedFixes)
|
||||
assertEquals(listOf("lint:ts# in <str>"), state.promotable().map { it.classKey })
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `StageFailed while class open contradicts the cluster`() {
|
||||
val state = fold(
|
||||
listOf(
|
||||
retry("fp1", session = "sa"), completed(session = "sa"),
|
||||
retry("fp1", session = "sb"), completed(session = "sb"),
|
||||
retry("fp1", session = "sc"), failed(session = "sc"),
|
||||
),
|
||||
)
|
||||
assertTrue(state.only.contradicted)
|
||||
assertTrue(state.promotable().isEmpty())
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `WorkflowFailed contradicts every open class in that session`() {
|
||||
val state = fold(
|
||||
listOf(
|
||||
retry("fp1", stage = "a", session = "sa", reason = "alpha broke"),
|
||||
retry("fp2", stage = "b", session = "sa", reason = "beta broke"),
|
||||
stored(WorkflowFailedEvent(SessionId("sa"), StageId("a"), "dead", true), "sa"),
|
||||
),
|
||||
)
|
||||
assertEquals(2, state.clusters.size)
|
||||
assertTrue(state.clusters.values.all { it.contradicted })
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `promotion is idempotent - a promoted class is not promotable again`() {
|
||||
val base = listOf(
|
||||
retry("fp1", session = "sa"), completed(session = "sa"),
|
||||
retry("fp1", session = "sb"), completed(session = "sb"),
|
||||
retry("fp1", session = "sc"), completed(session = "sc"),
|
||||
)
|
||||
val promoted = base + stored(ConceptPromotedEvent(SessionId("sc"), "fp1", "lint:boom", "lint", "concept", 3))
|
||||
assertTrue(fold(promoted).promotable().isEmpty())
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `a file written between retry and completion is captured as the validated fix ref`() {
|
||||
val state = fold(listOf(retry("fp1"), wrote("src/App.tsx", "hashA"), completed()))
|
||||
assertEquals("src/App.tsx", state.only.fixPath)
|
||||
assertEquals("hashA", state.only.fixHash)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `first validated fix ref wins and a later stage's writes do not back-attribute`() {
|
||||
val state = fold(
|
||||
listOf(
|
||||
retry("fp1", session = "sa"), wrote("first.kt", "h1", session = "sa"), completed(session = "sa"),
|
||||
retry("fp1", session = "sb"), wrote("second.kt", "h2", session = "sb"), completed(session = "sb"),
|
||||
),
|
||||
)
|
||||
assertEquals("first.kt", state.only.fixPath)
|
||||
assertEquals("h1", state.only.fixHash)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `signature is the first line of the failure reason`() {
|
||||
val state = fold(listOf(retry("fp1", reason = "detekt: MagicNumber\ntrace..."), completed()))
|
||||
assertEquals("detekt: MagicNumber", state.only.signature)
|
||||
}
|
||||
}
|
||||
+92
@@ -0,0 +1,92 @@
|
||||
package com.correx.core.kernel.orchestration
|
||||
|
||||
import com.correx.core.events.events.BuildPrerequisiteBootstrapAttemptedEvent
|
||||
import com.correx.core.events.events.EventMetadata
|
||||
import com.correx.core.events.events.EventPayload
|
||||
import com.correx.core.events.events.StoredEvent
|
||||
import com.correx.core.events.types.EventId
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.events.types.StageId
|
||||
import com.correx.core.transitions.graph.StageConfig
|
||||
import kotlinx.datetime.Instant
|
||||
import org.junit.jupiter.api.Assertions.assertEquals
|
||||
import org.junit.jupiter.api.Assertions.assertFalse
|
||||
import org.junit.jupiter.api.Assertions.assertNull
|
||||
import org.junit.jupiter.api.Assertions.assertTrue
|
||||
import org.junit.jupiter.api.Test
|
||||
|
||||
class BuildPrerequisiteDecisionTest {
|
||||
|
||||
private val reason =
|
||||
"stage impl repeatedly referenced missing build prerequisite 'frontend/package.json' " +
|
||||
"(3 blocked attempts). Create or repair the project setup before continuing."
|
||||
|
||||
@Test
|
||||
fun `decision maps the three facts to one bounded path`() {
|
||||
// not writable → route to a stage that can create the file.
|
||||
assertEquals(
|
||||
PrerequisiteAction.ROUTE_TO_RECOVERY,
|
||||
decidePrerequisiteAction(writable = false, inScope = true, bootstrapBudgetLeft = true),
|
||||
)
|
||||
// writable but out of scope → ask, don't guess.
|
||||
assertEquals(
|
||||
PrerequisiteAction.CLARIFY,
|
||||
decidePrerequisiteAction(writable = true, inScope = false, bootstrapBudgetLeft = true),
|
||||
)
|
||||
// writable, in scope, budget → grant the one bootstrap turn.
|
||||
assertEquals(
|
||||
PrerequisiteAction.BOOTSTRAP,
|
||||
decidePrerequisiteAction(writable = true, inScope = true, bootstrapBudgetLeft = true),
|
||||
)
|
||||
// writable, in scope, budget spent → escalate (the one turn didn't clear it).
|
||||
assertEquals(
|
||||
PrerequisiteAction.ESCALATE,
|
||||
decidePrerequisiteAction(writable = true, inScope = true, bootstrapBudgetLeft = false),
|
||||
)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `path is extracted from the block reason`() {
|
||||
assertEquals("frontend/package.json", buildPrerequisitePath(reason))
|
||||
assertNull(buildPrerequisitePath("some unrelated failure"))
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `an unconstrained stage owns everything but a scoped stage only its territory`() {
|
||||
val unconstrained = StageConfig()
|
||||
assertTrue(pathInDeclaredScope(unconstrained, "frontend/package.json"))
|
||||
|
||||
val scoped = StageConfig(touches = listOf("frontend/**"))
|
||||
assertTrue(pathInDeclaredScope(scoped, "frontend/package.json"))
|
||||
assertFalse(pathInDeclaredScope(scoped, "backend/package.json"))
|
||||
|
||||
val byExpected = StageConfig(touches = listOf("src/**"), expectedFiles = listOf("package.json"))
|
||||
assertTrue(pathInDeclaredScope(byExpected, "package.json"))
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `bootstrap budget counts prior grants for this stage only`() {
|
||||
val stage = StageId("impl")
|
||||
assertEquals(0, bootstrapAttemptCount(emptyList(), stage))
|
||||
val events = listOf(
|
||||
bootstrap(stage, "package.json"),
|
||||
bootstrap(StageId("other"), "package.json"),
|
||||
)
|
||||
assertEquals(1, bootstrapAttemptCount(events, stage))
|
||||
}
|
||||
|
||||
private var seq = 0L
|
||||
private fun bootstrap(stageId: StageId, path: String) = StoredEvent(
|
||||
metadata = EventMetadata(
|
||||
eventId = EventId("e${seq++}"),
|
||||
sessionId = SessionId("s1"),
|
||||
timestamp = Instant.parse("2026-01-01T00:00:00Z"),
|
||||
schemaVersion = 1,
|
||||
causationId = null,
|
||||
correlationId = null,
|
||||
),
|
||||
sequence = seq,
|
||||
sessionSequence = seq,
|
||||
payload = BuildPrerequisiteBootstrapAttemptedEvent(SessionId("s1"), stageId, path, "why") as EventPayload,
|
||||
)
|
||||
}
|
||||
+27
@@ -9,6 +9,9 @@ import com.correx.core.journal.model.DecisionKind
|
||||
import com.correx.core.journal.model.DecisionRecord
|
||||
import com.correx.core.utils.TypeId
|
||||
import kotlinx.coroutines.runBlocking
|
||||
import kotlinx.coroutines.sync.Mutex
|
||||
import kotlinx.coroutines.sync.withLock
|
||||
import kotlinx.coroutines.withTimeout
|
||||
import org.junit.jupiter.api.Assertions.assertEquals
|
||||
import org.junit.jupiter.api.Assertions.assertFalse
|
||||
import org.junit.jupiter.api.Assertions.assertTrue
|
||||
@@ -70,6 +73,30 @@ class JournalCompactionServiceTest {
|
||||
assertEquals(fixedArtifactId, event.summaryArtifactId)
|
||||
}
|
||||
|
||||
// Regression: append() flushes artifacts inside the SAME non-reentrant Mutex that flushBefore
|
||||
// holds. If compaction wraps its emit in flushBefore, the emit->append->flushBefore re-acquires
|
||||
// that Mutex and self-deadlocks. This store mirrors production locking so the deadlock is real;
|
||||
// the fake above cannot catch it because its flushBefore takes no lock.
|
||||
private fun reentrantHostileArtifactStore(): ArtifactStore = object : ArtifactStore {
|
||||
val mutex = Mutex()
|
||||
override suspend fun put(bytes: ByteArray) = fixedArtifactId
|
||||
override suspend fun get(id: TypeId): ByteArray? = null
|
||||
override suspend fun flushBefore(commit: suspend () -> Unit) = mutex.withLock { commit() }
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `does not deadlock when emit re-enters the artifact store (as append does)`(): Unit = runBlocking {
|
||||
val store = reentrantHostileArtifactStore()
|
||||
val svc = JournalCompactionService(store, { "summary" }, tokenThreshold = { 100 })
|
||||
val state = stateWithRecords(makeRecord(1, DecisionKind.INTENT))
|
||||
// emit simulates SqliteEventStore.append: it flushes artifacts inside the store mutex.
|
||||
withTimeout(2000) {
|
||||
svc.compactIfNeeded(SessionId("s1"), state, renderedTokenEstimate = 500) {
|
||||
store.flushBefore { /* persist event row */ }
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `only HIGH-salience records are included in the summarize prompt`(): Unit = runBlocking {
|
||||
val capturedPrompts = mutableListOf<String>()
|
||||
|
||||
+33
@@ -0,0 +1,33 @@
|
||||
package com.correx.core.kernel.orchestration
|
||||
|
||||
import org.junit.jupiter.api.Assertions.assertTrue
|
||||
import org.junit.jupiter.api.Test
|
||||
|
||||
class PackageNotFoundAdvisoryTest {
|
||||
|
||||
@Test
|
||||
fun `npm quoted-spec 404 names the scoped package without its version`() {
|
||||
val out = "npm error code E404\nnpm error 404 '@types/vite@^4.0.0' is not in this registry."
|
||||
val advisory = packageNotFoundAdvisory(out)
|
||||
assertTrue(advisory.contains("'@types/vite'"), advisory)
|
||||
assertTrue(advisory.contains("Edit the manifest"), advisory)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `npm GET-url 404 decodes the scope slash`() {
|
||||
val out = "npm error 404 Not Found - GET https://registry.npmjs.org/@types%2fvite - Not found"
|
||||
assertTrue(packageNotFoundAdvisory(out).contains("'@types/vite'"))
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `pnpm registry 404 names the package`() {
|
||||
val out = "ERR_PNPM_FETCH_404 GET https://registry.npmjs.org/leftpad-nope: Not Found - 404"
|
||||
assertTrue(packageNotFoundAdvisory(out).contains("'leftpad-nope'"))
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `unrelated failures produce no advisory`() {
|
||||
assertTrue(packageNotFoundAdvisory("tsc: type error in App.tsx").isEmpty())
|
||||
assertTrue(packageNotFoundAdvisory("npm warn deprecated foo@1.0.0").isEmpty())
|
||||
}
|
||||
}
|
||||
+72
@@ -0,0 +1,72 @@
|
||||
package com.correx.core.kernel.orchestration
|
||||
|
||||
import com.correx.core.events.events.EventMetadata
|
||||
import com.correx.core.events.events.EventPayload
|
||||
import com.correx.core.events.events.ExecutionPlanLockedEvent
|
||||
import com.correx.core.events.events.InitialIntentEvent
|
||||
import com.correx.core.events.events.StoredEvent
|
||||
import com.correx.core.events.events.WorkflowCompletedEvent
|
||||
import com.correx.core.events.types.ArtifactId
|
||||
import com.correx.core.events.types.EventId
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.events.types.StageId
|
||||
import kotlinx.datetime.Instant
|
||||
import org.junit.jupiter.api.Assertions.assertEquals
|
||||
import org.junit.jupiter.api.Assertions.assertTrue
|
||||
import org.junit.jupiter.api.Test
|
||||
|
||||
class PlanPatternMiningTest {
|
||||
|
||||
@Test
|
||||
fun `only a session whose executed plan completed is mined`() {
|
||||
val events =
|
||||
intent("s1", "build a react frontend that compiles") +
|
||||
locked("s1", "wf-s1", listOf("scaffold", "impl")) +
|
||||
completed("s1", "wf-s1") + // executed plan completed → mined
|
||||
intent("s2", "build a react frontend that compiles") +
|
||||
locked("s2", "wf-s2", listOf("a", "b")) // no completion → not mined
|
||||
val shapes = mineSuccessfulPlanShapes(events, exclude = "current")
|
||||
assertEquals(listOf("scaffold", "impl"), shapes.single().stageSequence)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `the current session is never mined from itself`() {
|
||||
val events = intent("me", "x y z frontend") + locked("me", "wf", listOf("a")) + completed("me", "wf")
|
||||
assertTrue(mineSuccessfulPlanShapes(events, exclude = "me").isEmpty())
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `keyword overlap ignores stopwords and short tokens`() {
|
||||
val a = intentKeywords("Build a React frontend that compiles")
|
||||
val b = intentKeywords("Create a React frontend with routing")
|
||||
assertTrue("react" in a && "frontend" in a)
|
||||
assertTrue("the" !in a && "a" !in a)
|
||||
assertTrue(keywordOverlap(a, b) > 0.0)
|
||||
assertEquals(0.0, keywordOverlap(a, emptySet()))
|
||||
}
|
||||
|
||||
private var seq = 0L
|
||||
private fun ev(sid: String, payload: EventPayload) = listOf(
|
||||
StoredEvent(
|
||||
metadata = EventMetadata(
|
||||
eventId = EventId("e${seq++}"),
|
||||
sessionId = SessionId(sid),
|
||||
timestamp = Instant.parse("2026-01-01T00:00:00Z"),
|
||||
schemaVersion = 1,
|
||||
causationId = null,
|
||||
correlationId = null,
|
||||
),
|
||||
sequence = seq,
|
||||
sessionSequence = seq,
|
||||
payload = payload,
|
||||
),
|
||||
)
|
||||
|
||||
private fun intent(sid: String, text: String) = ev(sid, InitialIntentEvent(SessionId(sid), text))
|
||||
private fun locked(sid: String, wf: String, stages: List<String>) = ev(
|
||||
sid,
|
||||
ExecutionPlanLockedEvent(SessionId(sid), ArtifactId("execution_plan"), wf, stages, stages.first()),
|
||||
)
|
||||
private fun completed(sid: String, wf: String) =
|
||||
ev(sid, WorkflowCompletedEvent(SessionId(sid), StageId("end"), 2, wf))
|
||||
}
|
||||
+17
@@ -51,4 +51,21 @@ class ProcessStaticAnalysisRunnerTest {
|
||||
val result = runner.run(dir, " ")
|
||||
assertTrue(result.exitCode != 0, "exit: ${result.exitCode}")
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `static floor skips an unsupported filetype without failing`() = runBlocking {
|
||||
val dir = createTempDirectory("sa-skip")
|
||||
dir.resolve("Main.kt").writeText("fun main() = Unit")
|
||||
val result = runner.run(dir, "correx-static-floor -- Main.kt")
|
||||
assertEquals(0, result.exitCode)
|
||||
assertTrue(result.output.contains("skipped"), "output: ${result.output}")
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `static floor checks javascript syntax without project dependencies`() = runBlocking {
|
||||
val dir = createTempDirectory("sa-js")
|
||||
dir.resolve("broken.js").writeText("const = ;")
|
||||
val result = runner.run(dir, "correx-static-floor -- broken.js")
|
||||
assertTrue(result.exitCode != 0, "exit: ${result.exitCode}")
|
||||
}
|
||||
}
|
||||
|
||||
+91
@@ -0,0 +1,91 @@
|
||||
package com.correx.core.kernel.orchestration
|
||||
|
||||
import com.correx.core.approvals.Tier
|
||||
import com.correx.core.events.events.EventMetadata
|
||||
import com.correx.core.events.events.EventPayload
|
||||
import com.correx.core.events.events.StoredEvent
|
||||
import com.correx.core.events.events.ToolExecutionFailedEvent
|
||||
import com.correx.core.events.events.ToolInvocationRequestedEvent
|
||||
import com.correx.core.events.events.ToolRequest
|
||||
import com.correx.core.events.types.EventId
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.events.types.StageId
|
||||
import com.correx.core.events.types.ToolInvocationId
|
||||
import kotlinx.datetime.Instant
|
||||
import org.junit.jupiter.api.Assertions.assertNotNull
|
||||
import org.junit.jupiter.api.Assertions.assertNull
|
||||
import org.junit.jupiter.api.Assertions.assertTrue
|
||||
import org.junit.jupiter.api.Test
|
||||
|
||||
class RepeatedToolFailureLoopTest {
|
||||
|
||||
private val stage = StageId("install_dependencies")
|
||||
|
||||
@Test
|
||||
fun `same-signature failures trip the limit even when interleaved with successes`() {
|
||||
// The rejection-loop breaker would reset on the interleaved success; this must not.
|
||||
val events = buildList {
|
||||
repeat(3) { addAll(failure("npm install @types/vite@4.0.0 -> registry 404 not found")) }
|
||||
add(success()) // resets any CONSECUTIVE counter
|
||||
repeat(3) { addAll(failure("npm install @types/vite@5.1.2 -> registry 404 not found")) }
|
||||
}
|
||||
val reason = detectRepeatedToolFailure(events, stage, limit = 6)
|
||||
assertNotNull(reason)
|
||||
assertTrue(reason!!.contains("install_dependencies"))
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `distinct failures below the limit do not trip`() {
|
||||
val events = listOf(
|
||||
failure("npm install a -> 404"),
|
||||
failure("tsc -> type error in App.tsx"),
|
||||
failure("eslint -> no config found"),
|
||||
).flatten()
|
||||
assertNull(detectRepeatedToolFailure(events, stage, limit = 6))
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `failures from other stages are not counted`() {
|
||||
val other = StageId("scaffold")
|
||||
val events = (1..8).flatMap { failure("npm install x -> 404", stageOf = other) }
|
||||
assertNull(detectRepeatedToolFailure(events, stage, limit = 6))
|
||||
}
|
||||
|
||||
private var seq = 0L
|
||||
private val session = SessionId("s1")
|
||||
|
||||
private fun ev(payload: EventPayload) = StoredEvent(
|
||||
metadata = EventMetadata(
|
||||
eventId = EventId("e${seq++}"),
|
||||
sessionId = session,
|
||||
timestamp = Instant.parse("2026-01-01T00:00:00Z"),
|
||||
schemaVersion = 1,
|
||||
causationId = null,
|
||||
correlationId = null,
|
||||
),
|
||||
sequence = seq,
|
||||
sessionSequence = seq,
|
||||
payload = payload,
|
||||
)
|
||||
|
||||
// A failure = the request (carries stageId) + the failure (carries only invocationId), correlated by id.
|
||||
private fun failure(reason: String, stageOf: StageId = stage): List<StoredEvent> {
|
||||
val id = ToolInvocationId("inv-${seq}")
|
||||
val req = ev(
|
||||
ToolInvocationRequestedEvent(
|
||||
invocationId = id, sessionId = session, stageId = stageOf,
|
||||
toolName = "shell", tier = Tier.T1,
|
||||
request = ToolRequest(id, session, stageOf, "shell"),
|
||||
),
|
||||
)
|
||||
return listOf(req, ev(ToolExecutionFailedEvent(id, session, "shell", reason)))
|
||||
}
|
||||
|
||||
private fun success() = ev(
|
||||
ToolInvocationRequestedEvent(
|
||||
invocationId = ToolInvocationId("ok-${seq}"), sessionId = session, stageId = stage,
|
||||
toolName = "shell", tier = Tier.T1,
|
||||
request = ToolRequest(ToolInvocationId("ok-$seq"), session, stage, "shell"),
|
||||
),
|
||||
)
|
||||
}
|
||||
+48
@@ -0,0 +1,48 @@
|
||||
package com.correx.core.kernel.orchestration
|
||||
|
||||
import com.correx.core.events.events.ConceptPromotedEvent
|
||||
import com.correx.core.events.types.SessionId
|
||||
import org.junit.jupiter.api.Assertions.assertEquals
|
||||
import org.junit.jupiter.api.Assertions.assertTrue
|
||||
import org.junit.jupiter.api.Test
|
||||
|
||||
class SelectPromotedConceptsTest {
|
||||
|
||||
private fun concept(classKey: String, gate: String, occ: Int) = ConceptPromotedEvent(
|
||||
sessionId = SessionId("__concept_compiler__"),
|
||||
fingerprint = classKey,
|
||||
classKey = classKey,
|
||||
gate = gate,
|
||||
conceptText = "text for $classKey",
|
||||
occurrences = occ,
|
||||
)
|
||||
|
||||
@Test
|
||||
fun `a file-write-requiring concept is withheld from a stage lacking file_write`() {
|
||||
val promoted = listOf(concept("contract:x", "contract", 5))
|
||||
assertTrue(selectPromotedConcepts(promoted, allowedTools = setOf("shell")).isEmpty())
|
||||
assertEquals(1, selectPromotedConcepts(promoted, allowedTools = setOf("file_write")).size)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `gates with no required capability are broadly relevant`() {
|
||||
val promoted = listOf(concept("lint:y", "lint", 3))
|
||||
assertEquals(1, selectPromotedConcepts(promoted, allowedTools = setOf("shell")).size)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `a concept contradicted after promotion is withheld`() {
|
||||
val promoted = listOf(concept("lint:y", "lint", 4))
|
||||
assertTrue(
|
||||
selectPromotedConcepts(promoted, allowedTools = setOf("shell"), contradicted = setOf("lint:y")).isEmpty(),
|
||||
)
|
||||
assertEquals(1, selectPromotedConcepts(promoted, allowedTools = setOf("shell")).size)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `top concepts by occurrence are kept within the cap`() {
|
||||
val promoted = (1..5).map { concept("lint:$it", "lint", occ = it) }
|
||||
val picked = selectPromotedConcepts(promoted, allowedTools = emptySet(), limit = 3)
|
||||
assertEquals(listOf("lint:5", "lint:4", "lint:3"), picked.map { it.classKey })
|
||||
}
|
||||
}
|
||||
+59
@@ -0,0 +1,59 @@
|
||||
package com.correx.core.kernel.orchestration
|
||||
|
||||
import com.correx.core.events.events.EventMetadata
|
||||
import com.correx.core.events.events.EventPayload
|
||||
import com.correx.core.events.events.FileWrittenEvent
|
||||
import com.correx.core.events.events.StoredEvent
|
||||
import com.correx.core.events.types.EventId
|
||||
import com.correx.core.events.types.SessionId
|
||||
import com.correx.core.events.types.ToolInvocationId
|
||||
import kotlinx.datetime.Instant
|
||||
import org.junit.jupiter.api.Assertions.assertEquals
|
||||
import org.junit.jupiter.api.Assertions.assertNotEquals
|
||||
import org.junit.jupiter.api.Test
|
||||
|
||||
class WorkspaceStateKeyTest {
|
||||
|
||||
@Test
|
||||
fun `key is stable for the same manifest and independent of write order`() {
|
||||
val a = workspaceStateKey(listOf(wrote("a.kt", "h1"), wrote("b.kt", "h2")))
|
||||
val b = workspaceStateKey(listOf(wrote("b.kt", "h2"), wrote("a.kt", "h1")))
|
||||
assertEquals(a, b)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `a later write to a file changes the key`() {
|
||||
val before = workspaceStateKey(listOf(wrote("a.kt", "h1")))
|
||||
val after = workspaceStateKey(listOf(wrote("a.kt", "h1"), wrote("a.kt", "h2")))
|
||||
assertNotEquals(before, after, "a changed post-image must invalidate a prior baseline")
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `latest post-image hash wins for a repeatedly-written path`() {
|
||||
val single = workspaceStateKey(listOf(wrote("a.kt", "h2")))
|
||||
val rewritten = workspaceStateKey(listOf(wrote("a.kt", "h1"), wrote("a.kt", "h2")))
|
||||
assertEquals(single, rewritten)
|
||||
}
|
||||
|
||||
private var seq = 0L
|
||||
private fun wrote(path: String, hash: String) = StoredEvent(
|
||||
metadata = EventMetadata(
|
||||
eventId = EventId("e${seq++}"),
|
||||
sessionId = SessionId("s1"),
|
||||
timestamp = Instant.parse("2026-01-01T00:00:00Z"),
|
||||
schemaVersion = 1,
|
||||
causationId = null,
|
||||
correlationId = null,
|
||||
),
|
||||
sequence = seq,
|
||||
sessionSequence = seq,
|
||||
payload = FileWrittenEvent(
|
||||
invocationId = ToolInvocationId("inv"),
|
||||
sessionId = SessionId("s1"),
|
||||
path = path,
|
||||
postImageHash = hash,
|
||||
preExisted = false,
|
||||
timestampMs = 1L,
|
||||
) as EventPayload,
|
||||
)
|
||||
}
|
||||
+25
-5
@@ -19,8 +19,11 @@ import java.nio.file.Path
|
||||
* workspace but outside the declared set is scope creep — the dominant local-implementer
|
||||
* failure that tests do not catch — and is raised as PATH_OUTSIDE_MANIFEST → BLOCK.
|
||||
*
|
||||
* Empty manifest = unrestricted (workspace containment still applies via
|
||||
* [PathContainmentRule]). Out-of-workspace targets are that rule's concern, not this one.
|
||||
* A write already inside the active task's affected_paths is allowed even if the manifest is
|
||||
* narrower: those paths are the agent-widenable, recorded authority (see [WriteScopeRule]), and
|
||||
* the stage manifest is a planner hint that defers to them. Empty manifest = unrestricted
|
||||
* (workspace containment still applies via [PathContainmentRule]). Out-of-workspace targets are
|
||||
* that rule's concern, not this one.
|
||||
* Path resolution goes through WorldProbe (symlink-safe) and the facts are recorded as
|
||||
* observations, so replay reads them back rather than re-globbing (invariant #9).
|
||||
*/
|
||||
@@ -36,6 +39,14 @@ class ManifestContainmentRule : ToolCallRule {
|
||||
val matchers = input.writeManifest.map {
|
||||
FileSystems.getDefault().getPathMatcher("glob:$it")
|
||||
}
|
||||
// The active task's affected_paths are the agent-widenable, recorded authority (see
|
||||
// WriteScopeRule). A write already inside that scope is not manifest scope-creep — the
|
||||
// stage manifest is a narrower planner hint that must defer to it, otherwise a too-tight
|
||||
// manifest becomes an unrecoverable dead-end (the escape hatch is task_update affected_paths).
|
||||
val taskScope = input.session.activeTask?.scope.orEmpty()
|
||||
val taskMatchers = taskScope.map {
|
||||
FileSystems.getDefault().getPathMatcher("glob:${it.removePrefix("./")}")
|
||||
}
|
||||
|
||||
val issues = mutableListOf<ValidationIssue>()
|
||||
val observations = mutableListOf<ToolCallObservation>()
|
||||
@@ -48,7 +59,9 @@ class ManifestContainmentRule : ToolCallRule {
|
||||
val resolvedReal = input.probe.resolveReal(resolvedInput)
|
||||
val inWorkspace = resolvedReal.startsWith(workspaceReal)
|
||||
val relative = if (inWorkspace) workspaceReal.relativize(resolvedReal).toString() else raw
|
||||
val inManifest = inWorkspace && matchers.any { it.matches(Path.of(relative)) }
|
||||
val relPath = Path.of(relative)
|
||||
val inManifest = inWorkspace && matchers.any { it.matches(relPath) }
|
||||
val inTaskScope = inWorkspace && taskMatchers.any { it.matches(relPath) }
|
||||
|
||||
observations += ToolCallObservation(
|
||||
ruleCode = RULE_CODE,
|
||||
@@ -57,14 +70,21 @@ class ManifestContainmentRule : ToolCallRule {
|
||||
"relative" to relative,
|
||||
"inWorkspace" to inWorkspace.toString(),
|
||||
"inManifest" to inManifest.toString(),
|
||||
"inTaskScope" to inTaskScope.toString(),
|
||||
),
|
||||
)
|
||||
|
||||
if (inWorkspace && !inManifest) {
|
||||
if (inWorkspace && !inManifest && !inTaskScope) {
|
||||
val remedy = if (taskScope.isEmpty()) {
|
||||
" Claim a task whose affected_paths cover this path (task_update), then retry."
|
||||
} else {
|
||||
" If this path is genuinely part of the task, widen its affected_paths via " +
|
||||
"task_update (note why), then retry."
|
||||
}
|
||||
issues += ValidationIssue(
|
||||
code = "PATH_OUTSIDE_MANIFEST",
|
||||
message = "Tool '${input.request.toolName}' writes '$raw' outside the stage's " +
|
||||
"declared manifest ${input.writeManifest}",
|
||||
"declared manifest ${input.writeManifest}.$remedy",
|
||||
severity = ValidationSeverity.ERROR,
|
||||
)
|
||||
disposition = maxAction(disposition, RiskAction.BLOCK)
|
||||
|
||||
+32
-1
@@ -24,7 +24,8 @@ class ManifestContainmentRuleTest {
|
||||
override fun resolveReal(path: Path): Path = path.toAbsolutePath().normalize()
|
||||
}
|
||||
|
||||
private fun input(pathArg: String, manifest: List<String>) = ToolCallAssessmentInput(
|
||||
private fun input(pathArg: String, manifest: List<String>, taskScope: List<String> = emptyList()) =
|
||||
ToolCallAssessmentInput(
|
||||
request = ToolRequest(
|
||||
ToolInvocationId("i"), SessionId("s"), StageId("st"), "file_write",
|
||||
mapOf("path" to pathArg, "mode" to "0644"),
|
||||
@@ -34,6 +35,8 @@ class ManifestContainmentRuleTest {
|
||||
probe = FakeProbe(),
|
||||
paramRoles = mapOf("path" to ParamRole.PATH),
|
||||
writeManifest = manifest,
|
||||
session = if (taskScope.isEmpty()) SessionContext()
|
||||
else SessionContext(activeTask = ActiveTask("t1", taskScope)),
|
||||
)
|
||||
|
||||
@Test
|
||||
@@ -67,6 +70,34 @@ class ManifestContainmentRuleTest {
|
||||
assertEquals("false", r.observations.single().facts["inManifest"])
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `write outside manifest but inside task scope is allowed`() {
|
||||
// The scaffold dead-end: manifest lists only two files, but the claimed task's
|
||||
// affected_paths cover the whole subtree. The recorded task scope wins.
|
||||
val r = rule.assess(
|
||||
input(
|
||||
"/work/project/frontend/src/main.tsx",
|
||||
manifest = listOf("frontend/package.json", "frontend/vite.config.ts"),
|
||||
taskScope = listOf("frontend/**"),
|
||||
),
|
||||
)
|
||||
assertEquals(RiskAction.PROCEED, r.disposition)
|
||||
assertTrue(r.issues.isEmpty())
|
||||
val facts = r.observations.single().facts
|
||||
assertEquals("false", facts["inManifest"])
|
||||
assertEquals("true", facts["inTaskScope"])
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `write outside both manifest and task scope is blocked with widen remedy`() {
|
||||
val r = rule.assess(
|
||||
input("/work/project/apps/x.kt", manifest = listOf("core/**"), taskScope = listOf("frontend/**")),
|
||||
)
|
||||
assertEquals(RiskAction.BLOCK, r.disposition)
|
||||
assertEquals("PATH_OUTSIDE_MANIFEST", r.issues.single().code)
|
||||
assertTrue(r.issues.single().message.contains("task_update"))
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `relative path arg is resolved against the workspace before matching`() {
|
||||
val r = rule.assess(input("core/a/B.kt", listOf("core/**")))
|
||||
|
||||
+32
-4
@@ -41,10 +41,38 @@ class DeclarativeCompressor(private val spec: OutputCompressionSpec) : ToolOutpu
|
||||
|
||||
private fun applyHeadTail(rule: HeadTail, lines: List<String>): List<String> {
|
||||
if (lines.size <= rule.head + rule.tail) return lines
|
||||
val elided = lines.size - rule.head - rule.tail
|
||||
return lines.take(rule.head) +
|
||||
"… $elided lines elided …" +
|
||||
lines.takeLast(rule.tail)
|
||||
val middle = lines.subList(rule.head, lines.size - rule.tail)
|
||||
val salienceRegex = rule.salience?.let { Regex(it, RegexOption.IGNORE_CASE) }
|
||||
val middleOut = if (salienceRegex == null) {
|
||||
listOf("… ${middle.size} lines elided …")
|
||||
} else {
|
||||
renderSalientMiddle(middle, salienceRegex, rule.salienceCap)
|
||||
}
|
||||
return lines.take(rule.head) + middleOut + lines.takeLast(rule.tail)
|
||||
}
|
||||
|
||||
// Walks the elided middle, keeping order and retaining up to [cap] salient lines in place;
|
||||
// runs of dropped lines around them collapse into a single elision marker each, so a decisive
|
||||
// error at line 250 of 500 survives even though the bulk of the log is still bounded.
|
||||
private fun renderSalientMiddle(middle: List<String>, salienceRegex: Regex, cap: Int): List<String> {
|
||||
val out = ArrayList<String>()
|
||||
var elidedCount = 0
|
||||
var keptSalient = 0
|
||||
for (line in middle) {
|
||||
val isSalient = keptSalient < cap && salienceRegex.containsMatchIn(line)
|
||||
if (isSalient) {
|
||||
if (elidedCount > 0) {
|
||||
out += "… $elidedCount lines elided …"
|
||||
elidedCount = 0
|
||||
}
|
||||
out += line
|
||||
keptSalient++
|
||||
} else {
|
||||
elidedCount++
|
||||
}
|
||||
}
|
||||
if (elidedCount > 0) out += "… $elidedCount lines elided …"
|
||||
return out
|
||||
}
|
||||
|
||||
private fun collapseConsecutive(lines: List<String>): List<String> {
|
||||
|
||||
+11
-2
@@ -38,11 +38,20 @@ sealed interface CompressionRule {
|
||||
|
||||
/**
|
||||
* When line count exceeds [head] + [tail], keep the first [head] and last
|
||||
* [tail] lines, replacing the middle with a single elision marker line.
|
||||
* [tail] lines. If [salience] is set, middle lines matching it (case-insensitive)
|
||||
* are also retained in place — up to [salienceCap] of them — so a decisive error
|
||||
* buried in the middle of a long log survives truncation; remaining elided runs
|
||||
* collapse to a single "… N lines elided …" marker. Without [salience] the whole
|
||||
* middle collapses to one marker, as before.
|
||||
*/
|
||||
@Serializable
|
||||
@SerialName("head_tail")
|
||||
data class HeadTail(val head: Int, val tail: Int) : CompressionRule
|
||||
data class HeadTail(
|
||||
val head: Int,
|
||||
val tail: Int,
|
||||
val salience: String? = null,
|
||||
val salienceCap: Int = 30,
|
||||
) : CompressionRule
|
||||
|
||||
/**
|
||||
* Collapse runs of identical adjacent lines into a single line, appending an
|
||||
|
||||
+24
@@ -44,6 +44,30 @@ class DeclarativeCompressorTest {
|
||||
assertEquals("line1\nline2\n… 6 lines elided …\nline9\nline10", out)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `HeadTail with salience retains a matching middle line otherwise elided`() {
|
||||
val lines = (1..20).map { if (it == 10) "boom: ERROR occurred" else "line$it" }
|
||||
val out = compress(OutputCompressionSpec(listOf(HeadTail(2, 2, salience = "error"))), lines.joinToString("\n"))
|
||||
assertEquals(
|
||||
"line1\nline2\n… 7 lines elided …\nboom: ERROR occurred\n… 8 lines elided …\nline19\nline20",
|
||||
out,
|
||||
)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `HeadTail with salience caps the number of retained salient lines`() {
|
||||
val lines = (1..20).map { "error$it" }
|
||||
val out = compress(OutputCompressionSpec(listOf(HeadTail(0, 0, salience = "error", salienceCap = 3))), lines.joinToString("\n"))
|
||||
assertEquals("error1\nerror2\nerror3\n… 17 lines elided …", out)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `HeadTail with salience preserves order and behaves like plain HeadTail when nothing matches`() {
|
||||
val raw = (1..10).joinToString("\n") { "line$it" }
|
||||
val out = compress(OutputCompressionSpec(listOf(HeadTail(2, 2, salience = "error"))), raw)
|
||||
assertEquals("line1\nline2\n… 6 lines elided …\nline9\nline10", out)
|
||||
}
|
||||
|
||||
@Test
|
||||
fun `HeadTail is a no-op at or under threshold`() {
|
||||
val raw = (1..4).joinToString("\n") { "line$it" }
|
||||
|
||||
@@ -27,6 +27,7 @@ CORREX kernel team.
|
||||
- `DefaultTransitionResolver` is stateless per call — it reads `EvaluationContext`, not persisted state.
|
||||
- Stage events are recorded by `DefaultStageExecutionEventMapper`; the mapper must emit events for every outcome (success, failure, skip).
|
||||
- `WorkflowGraph` is built from config/TOML at session start; it is immutable during a session.
|
||||
- `StageConfig.autoBuildGate` is a compiler-set request for a runtime build gate; it is used on write-declaring freestyle stages only when no explicit build expectation exists.
|
||||
- Cycle detection (`CycleExtractor`) runs during graph validation (`core:validation`), not at runtime.
|
||||
|
||||
## Verification
|
||||
|
||||
@@ -52,7 +52,7 @@ data class StageConfig(
|
||||
// correctness FAIL can block retryably until the review-block budget is spent. Default off.
|
||||
val semanticReview: Boolean = false,
|
||||
// Deterministic build-gate floor (staged-verification §Gate 4). Set by the compiler on the plan's
|
||||
// terminal stage when no stage declares an explicit [buildExpectation]. The LLM planner emits every
|
||||
// write-declaring plan stage when no stage declares an explicit [buildExpectation]. The LLM planner emits every
|
||||
// file-writing stage as the generic `file_written` kind (never a typed code kind) and rarely sets
|
||||
// build_expectation, so a plan that scaffolds real code would otherwise never hit an execution gate.
|
||||
// When this is set and NONE is declared, runExecutionGate promotes to a PROJECT build ONLY IF the
|
||||
|
||||
+2
-2
@@ -12,9 +12,9 @@ Maintained alongside the features they describe. Any agent shipping a significan
|
||||
|
||||
- `architecture/` — stable, high-level architectural docs (context layers, event model, replay model, security boundaries).
|
||||
- `decisions/` — ADRs (adr-NNNN-*.md). Append-only. Never delete or retroactively alter a decided ADR; write a superseding one instead.
|
||||
- `qa/` — QA run plans (QA-*.md). Each maps to a shipped feature. `TEMPLATE.md` is the canonical shape. `ENV.md` describes the required live environment. `README.md` explains the QA process.
|
||||
- `qa/` — QA run plans (QA-*.md). Each maps to a shipped feature or an explicitly pending controlled audition. `TEMPLATE.md` is the canonical shape. `ENV.md` describes the required live environment. `README.md` explains the QA process.
|
||||
- `specs/` — feature specs by date-slug. Inputs for planned or in-flight work.
|
||||
- `schemas/` — canonical JSON schemas for structured outputs (analysis, brief_echo, design, execution_plan, impl_plan). Shared across the router and validator.
|
||||
- `schemas/` — canonical JSON schemas for structured outputs (analysis, discovery brief, DoD, brief_echo, design, execution_plan, impl_plan). Shared across the router and validator.
|
||||
- `epics/`, `modules/`, `diagrams/`, `design/`, `reviews/`, `visual/` — supporting reference material.
|
||||
|
||||
**⚠️ STALE / DO NOT TRUST FOR STATUS:**
|
||||
|
||||
@@ -0,0 +1,150 @@
|
||||
# Correx — Catch-up for a ~2-month-old memory
|
||||
|
||||
**If your last memory of Correx is the epic-13/epic-14 era (mid-May 2026), read this.**
|
||||
|
||||
Back then the project was a *skeleton*: epics 0–14 had landed the module structure
|
||||
(events → sessions → transitions → validation → approvals → artifacts → context →
|
||||
tools → inference → kernel → infra → interfaces → router). It compiled and replayed,
|
||||
but the orchestration loop was thin and mostly unproven against real model runs.
|
||||
|
||||
Two months and ~250 feature commits later, the architecture is the *same* (all 9 Hard
|
||||
Invariants still hold; the event log is still the only source of truth), but nearly the
|
||||
entire *behavioral* layer — how a session actually drives a model through real work —
|
||||
was built and hardened by live QA. This document groups the major additions. It is a
|
||||
map, not a changelog; the dated files in `docs/plans/` are the real changelog.
|
||||
|
||||
Work is no longer tracked as "epics." It's tracked as **plans** (`docs/plans/`) and a
|
||||
**Vikunja backlog** (project_id 4).
|
||||
|
||||
---
|
||||
|
||||
## The single biggest correction: the TUI is now Go
|
||||
|
||||
The Kotlin TUI (Mosaic, then tamboui) was **retired**. The interactive terminal UI is
|
||||
now a **Go / Bubble Tea** app at `apps/tui-go` — a WS client of the server. `apps/cli`
|
||||
(Clikt, Kotlin) and `apps/server` (Ktor) are the only Gradle app modules; the old
|
||||
`apps/desktop` / `apps/worker` stubs were deleted. If you remember tamboui, forget it.
|
||||
|
||||
## New whole subsystems (did not meaningfully exist at epic-14)
|
||||
|
||||
**Native task tracking (`core:tasks`).** A dependency-aware work graph: `task_decompose`
|
||||
splits a goal into a DEPENDS_ON graph in one approval; tasks have claim gates
|
||||
(dependency-hard-gate, cite-before-claim, duplicate-title guard), per-task history,
|
||||
markdown export, a full REST surface, a `correx task` CLI, a TUI task board with
|
||||
readiness, and **git-driven status** (a commit mention → IN_PROGRESS, a closing keyword
|
||||
→ DONE, idempotent). The execution loop is now *tasked* — it replaced the old linear
|
||||
role_pipeline.
|
||||
|
||||
**Plane-2 tool-call intent validation (`core:toolintent`).** An anti-hallucination /
|
||||
safety layer that assesses every tool call *before* it runs and records
|
||||
`ToolCallAssessedEvent`: path-containment, read-before-write, reference-must-exist,
|
||||
write-scope adherence, stale-write, exec-interpreter and network-host rules, and a
|
||||
per-session egress allowlist. This is the layer that stops an agent citing files it
|
||||
never read or writing outside its declared scope.
|
||||
|
||||
**Compression pipeline (`infrastructure:compression`).** A staged, replay-safe context
|
||||
compressor: level policy → fact sheet + strict allocation → tier summarizer → token
|
||||
pruning + embedding relevance + ToMe merge → static-doc pruning (CLAUDE.md/AGENTS.md).
|
||||
Distinct from the required/optional *bucket* rework in `core:context`.
|
||||
|
||||
**Staged verification & review gates.** Stage output passes a gate ladder instead of
|
||||
being trusted: build gate, plan-compile gate, contract/execution gate, and a
|
||||
semantic-review gate (`core:critique`, with structured `CritiqueFinding` + per-model
|
||||
calibration). Per-gate retry budgets with progress-aware charging and hybrid salvage;
|
||||
static-first reviewer framing; capability-gap reflection; brief echo-back gate.
|
||||
|
||||
**Research workflow.** `WebSearchTool` (local SearXNG), `WebFetchTool` (bounded fetch),
|
||||
deterministic HTML→markdown extraction, a research workflow graph, batch source-fetch
|
||||
approval, and dedicated `SourceFetched` / `LowQualityExtraction` events. On by default.
|
||||
|
||||
**Cross-session repo memory (L3 + repo-map + project profile).** `RepoMapIndexer`
|
||||
(symbols for Kotlin, GDScript, C#/Godot-Mono, markdown headings), `RepoKnowledgeRetriever`
|
||||
with recency fallback, L3 ANN retrieval (`in_memory` or `turbovec` sidecar) recorded as
|
||||
environment observations, `ProjectMemoryService`/`Distiller`, and `ProjectProfile`
|
||||
(per-repo standing context at `.correx/project.toml`) injected as L0. Note: this is
|
||||
*repo-scoped* memory — the "cross-session memory" anti-feature (conversational recall)
|
||||
is still deliberately out.
|
||||
|
||||
**Git run-branch transport (the "Gitea transport") — SHIPPED.** The server owns a Git
|
||||
checkout; each run pushes to a run branch (`GitRunBranchTransport`, `RunBranchPushedEvent`);
|
||||
`GitTaskSync`/`GitCommandCommitReader` drive task status from commits. "gitea" is just
|
||||
the configured remote name; the transport is plain Git.
|
||||
|
||||
**Observability & replay tooling (Epic 15, largely shipped).** Event-stream inspector
|
||||
(`correx events`, `/sessions/{id}/events`), session replay + determinism digest,
|
||||
causation-graph DOT export, metrics as a replayable projection (`correx stats`),
|
||||
event-sourced health checks (EventStore latency, llama-server liveness, disk watermark,
|
||||
ROCm/VRAM probe), and correlation-structured MDC logging.
|
||||
|
||||
**Model lifecycle management (`[[models]]`).** Correx spawns/owns the llama-server
|
||||
process: per-stage model selection, manual swap + pin, resource telemetry, VRAM gauge.
|
||||
(The autonomous *residency scheduler* is still unbuilt — see below.)
|
||||
|
||||
**Workspace scoping & undo.** `WorkspaceResolver` trust pipeline + `allowed_workspace_roots`,
|
||||
per-session workspace-scoped tools/policy, client→server workspace handshake, crash-safe
|
||||
atomic file writes with pre/post-image captured to CAS (`FileWrittenEvent`), and a
|
||||
`FileMutationReverser` undo primitive (server endpoint + CLI). Agents can also READ
|
||||
outside `workspace_root` via an operator approval prompt (writes stay jailed).
|
||||
|
||||
**Approvals & grants.** Cross-session grant scopes (PROJECT/GLOBAL) + revoke,
|
||||
grant-aware approval engine, risk rationale surfaced to the operator; approval gates now
|
||||
block indefinitely instead of auto-rejecting on timeout, and steering actually affects
|
||||
the run.
|
||||
|
||||
**Router interaction layer.** Beyond CHAT+STEERING: grounded system prompts, triage
|
||||
directive (no bare refusals), structured **workflow proposals** from triage, a
|
||||
**clarification-question loop** (analyst asks, operator answers, producer-exit rehydrate
|
||||
on reconnect), **rubber-duck idea board** (capture/feed/promote to project profile), and
|
||||
grounded **narration** (pinned narration model, latency/token metrics surfaced).
|
||||
|
||||
**Freestyle / execution-plan engine.** Two-phase planning→execution driver,
|
||||
`ExecutionPlanCompiler` + `ExecutionPlanLockedEvent`, post-plan operator approval gate,
|
||||
freestyle graph re-routing (deterministic override), soft-lock steering preemption,
|
||||
plan grounding + positive-pattern mining + a stage-prompt audition rig.
|
||||
|
||||
**Decision journal (`core:journal`).** Decision-journal projection injected into stage
|
||||
context, salience-aware compaction (`JournalCompactionService`, CAS-rendered).
|
||||
|
||||
**Personalization (`core:config`).** `OperatorProfile` + `ProfileLoader` bound at start
|
||||
and surfaced into L0; propose-only `ProfileAdaptationService`.
|
||||
|
||||
**Native MCP host.** The server mounts external stdio MCP servers as first-class Correx
|
||||
tools (inherit tier / receipt / replay). `codebase-memory-mcp` is installed and granted
|
||||
per code-intel stage.
|
||||
|
||||
**Recovery loop.** Failed write-less stages route to recovery instead of futile retry;
|
||||
tier-2 intent-holder arbiter; remaining-delta pinning; failure-ticket routing +
|
||||
review-gate RECOVER + return-to-sender; structured package-404 recovery evidence;
|
||||
stage-global repeated-failure loop breaker.
|
||||
|
||||
**Godot / game-dev support.** GDScript + C#/Godot-Mono symbol extraction in the repo
|
||||
map, and a structural `.tscn`/`.tres` scene validator.
|
||||
|
||||
## Refactors & hardening you'll notice
|
||||
|
||||
- `DefaultSessionOrchestrator` god-class decomposed into per-concern extensions;
|
||||
`DomainEventMapper`'s god-`when` split per-domain. Detekt baseline ratcheted 120 → 90.
|
||||
- Persistence hardened: sequences assigned atomically inside INSERT, reads serialized
|
||||
with the append transaction, slow WS clients no longer stall the kernel.
|
||||
- Tool results bounded + framed, full output spilled to CAS with a `tool_output`
|
||||
retrieval tool; `glob`/`grep` search tools; web_fetch SSRF fix; interruptible shell
|
||||
timeouts with process-tree kill; shell allowlist validates every command position.
|
||||
- Config: orchestration loop/threshold/budget constants moved to `[orchestration]`;
|
||||
operator-tunable sampling knobs (top_k/min_p/repeat_penalty) per stage.
|
||||
|
||||
## Still planned / deliberately NOT built (don't assume these exist)
|
||||
|
||||
- Full **remote always-on / thin-client** deployment topology. Its Git *transport*
|
||||
shipped (above); the hosting topology itself is not yet stood up.
|
||||
- Full router **context isolation** (persistent conversation history, session-scoped
|
||||
boundaries). CHAT+STEERING works; the isolation layer is deferred.
|
||||
- Autonomous GPU **residency scheduling** (lifecycle *is* built; idle-eviction policy
|
||||
is not).
|
||||
- Still explicitly out: parallel agent execution, conversational cross-session memory,
|
||||
three-critic ensemble, fine-tuning, streaming inference.
|
||||
|
||||
## Where to look now
|
||||
|
||||
- `CLAUDE.md` — current session guide, Module Map, invariants.
|
||||
- `docs/plans/` — the real changelog of intent since epic-14 (dated files).
|
||||
- Vikunja project 4 — live backlog. `scripts/ctx.py <query>` — ranked file/symbol lookup.
|
||||
@@ -0,0 +1,141 @@
|
||||
# Stage prompt audition results — 2026-07-16
|
||||
|
||||
## Decision
|
||||
|
||||
Do not claim a material performance benefit for `CURATED_STAGE_OPERATING_GUIDANCE` from this audition. Keep or remove it on clarity and token-cost grounds, not on measured workflow efficiency.
|
||||
|
||||
Both variants completed and built successfully in all five controlled samples. Guidance ON had a slightly lower median inference count, but a slightly higher mean because of one severe failure loop. Pairwise outcomes and aggregate error counts do not show a stable causal advantage. The defensible finding is **no demonstrated benefit and no demonstrated final-outcome harm, with high run-to-run variance in both variants**.
|
||||
|
||||
The guidance block under test was:
|
||||
|
||||
```text
|
||||
## Operating guidance
|
||||
Verify the current workspace before declaring completion. Read before modifying existing files.
|
||||
When the authoritative intent plainly requires project setup, creating its manifest, configuration,
|
||||
or entry file is in scope; do not spend turns re-deciding that settled boundary. Re-observe facts
|
||||
instead of assuming them, and use the exact gate/tool feedback to make the smallest effective fix.
|
||||
```
|
||||
|
||||
Guidance OFF removed only this L0 system entry through `CORREX_STAGE_GUIDANCE=off`.
|
||||
|
||||
## Controlled batch
|
||||
|
||||
- Intent: scaffold a minimal Vite + React + TypeScript frontend in `frontend/` and make `npm run build` pass.
|
||||
- Scratch workspace: `/tmp/qa-audition-ws`, wiped before every sample.
|
||||
- Driver: `scripts/prompt-audition.sh` with `BATCH_RUNS=5`, variants `on off`, and `POLL_SECS=1200`.
|
||||
- Containment gate: every sample required matching `SessionWorkspaceBound.workspaceRoot` and `WorkspaceStateObserved.workspaceRoot`; any emitted `RepoMapComputed.repoRoot` also had to match.
|
||||
- Completion gate: only a `WorkflowCompleted` or `WorkflowFailed` after `ExecutionPlanLocked` counted.
|
||||
- Approvals: the unattended driver approved pending T2 gates every 15 seconds.
|
||||
- Build gate: after the workflow terminal, the driver independently ran `npm run build` in the generated frontend.
|
||||
|
||||
### Per-run results
|
||||
|
||||
| Pair | Variant | Session | Terminal | Build | Inferences | Approvals | Tools completed | Rejected | Failed | Retries |
|
||||
|---:|---|---|---|---|---:|---:|---:|---:|---:|---:|
|
||||
| 1 | ON | `c9d4a30e-b71d-4137-a850-9b6428e30137` | completed | passed | 20 | 10 | 13 | 0 | 1 | 0 |
|
||||
| 1 | OFF | `c656e3ca-b8dd-43b4-97d9-74add7e05cdc` | completed | passed | 24 | 11 | 16 | 0 | 1 | 1 |
|
||||
| 2 | ON | `62929ec7-8216-4a53-a300-3fa61ff7e547` | completed | passed | 20 | 13 | 14 | 0 | 0 | 0 |
|
||||
| 2 | OFF | `1af1364b-9fcb-48b3-bbe8-90110f77f53d` | completed | passed | 21 | 13 | 14 | 0 | 0 | 1 |
|
||||
| 3 | ON | `310f7220-3157-4567-a495-7be217d2c1df` | completed | passed | 68 | 46 | 33 | 2 | 27 | 0 |
|
||||
| 3 | OFF | `10c35e0d-8c63-40a8-a948-b9272407ca5f` | completed | passed | 27 | 14 | 20 | 0 | 1 | 0 |
|
||||
| 4 | ON | `6e3f8809-93df-4e58-9ca5-7f05b3b0500a` | completed | passed | 18 | 12 | 12 | 0 | 0 | 0 |
|
||||
| 4 | OFF | `362bb82d-71dc-497f-ad73-870db5c33e72` | completed | passed | 21 | 14 | 14 | 0 | 1 | 0 |
|
||||
| 5 | ON | `84e69b2a-73f8-4052-a05a-00f7ab0f9349` | completed | passed | 44 | 22 | 33 | 0 | 3 | 1 |
|
||||
| 5 | OFF | `a160a33e-51a5-4e20-98c9-5a635a276fd5` | completed | passed | 67 | 32 | 49 | 2 | 8 | 0 |
|
||||
|
||||
### Aggregate results
|
||||
|
||||
| Metric | Guidance ON | Guidance OFF | Interpretation |
|
||||
|---|---:|---:|---|
|
||||
| Workflow success | 5/5 | 5/5 | no difference |
|
||||
| Independent build success | 5/5 | 5/5 | no difference |
|
||||
| Inferences, mean | 34.0 | 32.0 | OFF lower by 2; outlier-sensitive |
|
||||
| Inferences, median | 20 | 24 | ON lower by 4 |
|
||||
| Inferences, range | 18–68 | 21–67 | both have large tails |
|
||||
| Approvals, mean | 20.6 | 16.8 | OFF lower, dominated by ON run 3 |
|
||||
| Approvals, median | 13 | 14 | effectively tied |
|
||||
| Tools completed, mean | 21.0 | 22.6 | effectively tied |
|
||||
| Rejections, total | 2 | 2 | tied |
|
||||
| Failures, total | 31 | 11 | OFF lower; 27 ON failures came from run 3 |
|
||||
| Retries, total | 1 | 2 | ON lower by one |
|
||||
|
||||
ON used fewer inferences in four of five paired comparisons, but the single ON run-3 failure loop erased that advantage in the mean. OFF then produced its own long-tail result in run 5. With five samples per variant, the distribution is too small and heavy-tailed to attribute these differences to the guidance block.
|
||||
|
||||
## ON run 3 failure analysis
|
||||
|
||||
The error did not originate in the user intent, analyst artifact, operating guidance, or prior-plan hint. The architect inference generated a locked execution plan whose `scaffold_files` prompt included the nonexistent npm package:
|
||||
|
||||
```json
|
||||
"@types/vite": "^4.0.0"
|
||||
```
|
||||
|
||||
That generated prompt became authoritative downstream context, and `scaffold_files` wrote it into `frontend/package.json`. The structural plan and file gates accepted the manifest because it was valid JSON with the required keys; they do not resolve package names.
|
||||
|
||||
`npm install` returned an exact registry 404 for `@types/vite`. The model nevertheless retried npm repeatedly, tried explicit versions and flags, switched to Yarn, probed pnpm and network state, and hit two read-before-write rejections before eventually rewriting the manifest without the invalid package. Stage inference counts were:
|
||||
|
||||
| Stage | Inferences |
|
||||
|---|---:|
|
||||
| `scaffold_files` | 31 |
|
||||
| `install_dependencies` | 26 |
|
||||
| `verify_build` | 6 |
|
||||
| `analyst` | 2 |
|
||||
| `discovery` | 2 |
|
||||
| `architect` | 1 |
|
||||
|
||||
The guidance sentence about using exact feedback and making the smallest fix was directly applicable but did not stop the loop. This argues for deterministic defenses rather than stronger prose alone:
|
||||
|
||||
- Validate or resolve manifest dependencies before locking or accepting a generated scaffold.
|
||||
- Bound repeated equivalent failures within a stage.
|
||||
- Convert an unambiguous package 404 into structured recovery evidence that identifies the offending manifest entry.
|
||||
- Require a materially different action after repeated identical failures.
|
||||
|
||||
## Earlier samples
|
||||
|
||||
Earlier exploratory sessions suggested that ON might be cheaper than OFF, followed by an ON repeat that varied substantially. Those samples are excluded from the controlled aggregate because the later audit found a separate `[project].root` leak: tool writes were contained in scratch, but repo-map and project-memory context could still be sourced from the real Correx repository.
|
||||
|
||||
The server now rebinds project observation and memory to the authoritative boot workspace, and the batch driver checks the recorded project-observation root before allowing a sample to proceed. Earlier session IDs remain useful only as exploratory history:
|
||||
|
||||
- First apparent ON/OFF pair: `742e6330-f4ab-42a4-9466-4c8343452560`, `83ae4e27-ed4b-4d45-ad90-2db177487eaa`.
|
||||
- Additional ON repeat: `9721ba88-4819-401b-8d68-5d667ecdfe64`.
|
||||
- Discarded contaminated preflight sample: `8a1a5a3d-7177-4682-afc1-61e179aaa95c`.
|
||||
|
||||
Do not combine their metrics with the five-pair table.
|
||||
|
||||
## Artifacts and reproduction
|
||||
|
||||
Batch artifacts are local and gitignored under:
|
||||
|
||||
```text
|
||||
scripts/output/prompt-audition-20260716-165518/
|
||||
```
|
||||
|
||||
Important files:
|
||||
|
||||
- `results.tsv` — authoritative per-run metric table.
|
||||
- `batch.log` — unattended driver progress and final rendered table.
|
||||
- `server-NN-on.log`, `server-NN-off.log` — full server/inference/event logs for each sample.
|
||||
- `build-NN-on.log`, `build-NN-off.log` — independent post-terminal build output.
|
||||
- `pid` — detached batch PID used during the run; the process has exited.
|
||||
|
||||
Reproduce a five-pair detached batch with:
|
||||
|
||||
```bash
|
||||
DETACH=1 BATCH_RUNS=5 POLL_SECS=1200 WORKDIR=/tmp/qa-audition-ws \
|
||||
bash scripts/prompt-audition.sh
|
||||
```
|
||||
|
||||
The command prints the timestamped batch directory. A single pair remains the default when `BATCH_RUNS` is omitted. `VARIANTS=on` or `VARIANTS=off` runs only one side.
|
||||
|
||||
## Limitations
|
||||
|
||||
- No deterministic model seed was pinned, so the audition measures observed stochastic behavior rather than a reproducible seeded benchmark.
|
||||
- One task fixture cannot establish general guidance value across coding, research, and repair workflows.
|
||||
- Five samples per variant are enough to expose variance but not enough for a strong statistical claim about heavy-tailed behavior.
|
||||
- Cross-session “plan shape that worked before” memory remained part of normal runtime context for both variants; only the operating-guidance entry differed.
|
||||
- Metrics count event-log activity, not token usage or wall-clock duration per stage.
|
||||
|
||||
## Recommendation
|
||||
|
||||
Treat the current guidance block as performance-neutral and non-protective. If its token cost is material, remove or shorten it unless it has a separate clarity or policy rationale. Prioritize deterministic plan/package validation and bounded recovery loops; those address the observed failure mechanism directly.
|
||||
|
||||
If further prompt evidence is desired, run a seeded matrix across multiple task fixtures and compare distributions, not single-run totals. Record token counts and stage durations in the batch summary before the next audition.
|
||||
@@ -0,0 +1,34 @@
|
||||
# QA Plan: Stage prompt audition
|
||||
|
||||
**Status:** COMPLETED — guidance benefit not demonstrated
|
||||
**Run date / operator:** 2026-07-16 — local 12B audition; unseeded stochastic batch
|
||||
**BACKLOG item:** Vikunja #169
|
||||
|
||||
**Results:** [QA-stage-prompt-audition-results-2026-07-16.md](QA-stage-prompt-audition-results-2026-07-16.md)
|
||||
|
||||
## Preconditions
|
||||
|
||||
- [x] Use one fixed intent and a freshly wiped scratch workspace per variant.
|
||||
- [x] Retain per-session server logs, independent build logs, and a machine-readable result table.
|
||||
- [ ] Pin and record a deterministic seed and complete model checksum/config metadata in a future benchmark-grade rerun.
|
||||
|
||||
## Acceptance gate
|
||||
|
||||
> A curated prompt variant is adopted only if it improves gate pass rate or wasted tool rounds without increasing context truncation on the same model and task fixture.
|
||||
|
||||
## Checks
|
||||
|
||||
| # | Action | Expected observable evidence | Result |
|
||||
|---|---|---|---|
|
||||
| 1 | Run guidance ON and OFF variants for five samples each. | Session event logs identify every stage inference and terminal workflow outcome. | Pass: 10/10 completed |
|
||||
| 2 | Compare build success, inference turns, approvals, tool outcomes, and retries. | Per-variant result table derived from events against the same fixture. | Pass: results report committed |
|
||||
| 3 | Select the smallest improving variant. | A committed finding names the selected variant and evidence; otherwise no prompt expansion lands. | No winner: benefit not demonstrated |
|
||||
|
||||
## Current static audit finding
|
||||
|
||||
The runtime has two stage-facing sources: workflow prompt files and the compact `CURATED_STAGE_OPERATING_GUIDANCE` L0 system entry. The completed five-pair audition found identical final success and no stable efficiency improvement from guidance. See the linked results report for the controlled data, excluded exploratory sessions, and the architect-generated `@types/vite` failure loop.
|
||||
|
||||
## Out of scope
|
||||
|
||||
- A live benchmark result; this repository has no fixed model artifact or benchmark fixture checked in.
|
||||
- Replacing deterministic gates with prompt text.
|
||||
@@ -135,6 +135,10 @@ backend = "in_memory" # or "turbovec"
|
||||
# schema_path = "schemas/review_report.json"
|
||||
# llm_emitted = true
|
||||
#
|
||||
# Review loops escalate to the synthesized recovery stage after this many review→rework cycles.
|
||||
# [orchestration]
|
||||
# review_loop_max_cycles = 3
|
||||
#
|
||||
# The bundled examples/workflows/review_loop.toml uses this kind: the reviewer emits a
|
||||
# review_report whose `verdict` field gates the implementer↔reviewer loop via
|
||||
# artifact_field_equals transitions. See docs/schemas/review_report.json for the schema.
|
||||
@@ -143,3 +147,8 @@ backend = "in_memory" # or "turbovec"
|
||||
id = "execution_plan"
|
||||
schema_path = "schemas/execution_plan.json"
|
||||
llm_emitted = true
|
||||
|
||||
[[artifacts]]
|
||||
id = "dod"
|
||||
schema_path = "schemas/dod.json"
|
||||
llm_emitted = true
|
||||
|
||||
@@ -1,6 +1,20 @@
|
||||
{
|
||||
"type": "object",
|
||||
"properties": {
|
||||
"brief": {
|
||||
"type": "object",
|
||||
"properties": {
|
||||
"what": { "type": "string" },
|
||||
"why": { "type": "string" },
|
||||
"who": { "type": "array", "items": { "type": "string" } },
|
||||
"scope": { "type": "array", "items": { "type": "string" } },
|
||||
"non_goals": { "type": "array", "items": { "type": "string" } },
|
||||
"constraints": { "type": "array", "items": { "type": "string" } },
|
||||
"assumptions": { "type": "array", "items": { "type": "string" } }
|
||||
},
|
||||
"required": ["what", "why", "who", "scope", "non_goals", "constraints", "assumptions"],
|
||||
"additionalProperties": false
|
||||
},
|
||||
"ready": {
|
||||
"type": "boolean",
|
||||
"description": "true when the request is clear and grounded enough to plan; false when you are raising questions"
|
||||
@@ -33,6 +47,6 @@
|
||||
}
|
||||
}
|
||||
},
|
||||
"required": ["ready", "questions"],
|
||||
"required": ["brief", "ready", "questions"],
|
||||
"additionalProperties": false
|
||||
}
|
||||
|
||||
@@ -0,0 +1,24 @@
|
||||
{
|
||||
"type": "object",
|
||||
"properties": {
|
||||
"summary": { "type": "string" },
|
||||
"criteria": {
|
||||
"type": "array",
|
||||
"minItems": 1,
|
||||
"items": {
|
||||
"type": "object",
|
||||
"properties": {
|
||||
"id": { "type": "string" },
|
||||
"statement": { "type": "string" },
|
||||
"part": { "type": "string" },
|
||||
"verified_by": { "type": "string", "description": "one of: gate, reviewer" }
|
||||
},
|
||||
"required": ["id", "statement", "part", "verified_by"],
|
||||
"additionalProperties": false
|
||||
}
|
||||
},
|
||||
"out_of_scope": { "type": "array", "items": { "type": "string" } }
|
||||
},
|
||||
"required": ["summary", "criteria", "out_of_scope"],
|
||||
"additionalProperties": false
|
||||
}
|
||||
@@ -14,6 +14,10 @@
|
||||
"produces": { "type": "string" },
|
||||
"kind": { "type": "string" },
|
||||
"tools": { "type": "array", "items": { "type": "string" } }
|
||||
,"writes": { "type": "array", "items": { "type": "string" } }
|
||||
,"touches": { "type": "array", "items": { "type": "string" } }
|
||||
,"build_expectation": { "type": "string", "description": "one of: none, module, project, tests" }
|
||||
,"semantic_review": { "type": "boolean" }
|
||||
},
|
||||
"required": ["id", "prompt", "produces"]
|
||||
}
|
||||
|
||||
@@ -0,0 +1,12 @@
|
||||
# Capability accretion
|
||||
|
||||
Make run N+1 better through deterministic, replay-safe facts mined from validated prior runs—not model training or mutable hidden memory.
|
||||
|
||||
Promote a validated failure-to-fix pair by a reusable class key: gate, evaluator/toolchain kind, and normalized failure fingerprint. Store a reference to the validated fix artifact/diff and the evidence that it passed.
|
||||
|
||||
1. Extend the concept rails to retain `classKey`, `fixRef`, confidence, and contradiction state.
|
||||
2. Deliver high-confidence facts deterministically at plan compilation (contract/gate tightening) or as a bounded stage instruction. L3 remains an instance-recall fallback.
|
||||
3. Mine positive patterns separately: successful plan shapes, resolved commands, and useful retrievals.
|
||||
4. Revoke or decay facts when later recorded evidence contradicts them.
|
||||
|
||||
Every promotion and delivery is event-derived and recorded; replay never re-mines live state.
|
||||
@@ -0,0 +1,107 @@
|
||||
# Closed-loop workspace
|
||||
|
||||
## Decision
|
||||
|
||||
Treat workspace truth as a recorded control-plane fact, not a terminal-stage hope. A plan may run
|
||||
only after its declared assumptions are grounded; every code-producing stage must leave a recorded
|
||||
verified increment before another implementation stage proceeds. Artifact-schema validation remains
|
||||
useful, but it is not evidence that the workspace compiles, builds, or satisfies its declared
|
||||
preconditions.
|
||||
|
||||
## Known-good workspace invariant
|
||||
|
||||
After a stage that writes code/configuration, the orchestrator records one verification observation
|
||||
for the workspace state produced by that stage. The next implementation stage may rely only on a
|
||||
passing observation whose workspace state key is the current recorded state key.
|
||||
|
||||
- A passing observation is the authoritative `known-good` baseline.
|
||||
- A failed or unavailable observation is a local stage failure: retry the owner, route a recovery
|
||||
ticket, or ask for clarification; do not continue the normal plan edge.
|
||||
- A docs-only stage and a stage with no declared writes do not manufacture a compiler/build claim.
|
||||
- Replay reads the recorded observation and result. It never reruns a command or rescans the live
|
||||
workspace.
|
||||
|
||||
The existing `StaticAnalysisCompletedEvent` records command output. The implementation should add a
|
||||
small workspace-verification result event (or extend that event deliberately) that binds: session,
|
||||
stage, state key, declared write paths, selected command/expectation, result, and the observation
|
||||
sequence. That binding prevents a later dirty workspace from being mistaken for the state that was
|
||||
verified.
|
||||
|
||||
## Seam 1: plan grounding before lock
|
||||
|
||||
Plan compilation remains deterministic. Grounding is a distinct phase after structural compilation
|
||||
and before `ExecutionPlanLockedEvent`, because it needs recorded workspace facts.
|
||||
|
||||
Inputs, all from the current session's recorded observations:
|
||||
|
||||
| Check | Evidence | Outcome |
|
||||
|---|---|---|
|
||||
| Declared writes/touches | workspace root and path policy; plan manifest | reject unsafe/out-of-scope paths before lock |
|
||||
| Referenced existing paths | repo-map/workspace-state index | report an absent or ambiguous reference to the architect |
|
||||
| Referenced symbols | grounding-grade symbol index, not L3 similarity | report unresolved symbols with candidate paths |
|
||||
| Build prerequisites | project profile commands plus detected manifest/config files | require an explicit bootstrap stage, clarification, or verified prerequisite |
|
||||
| Stage ordering | writes, prerequisites, and verification requirements | reject a stage that depends on an unverified prior increment |
|
||||
|
||||
The repo map is an input catalog, not proof: its L3 embeddings are deliberately excluded from this
|
||||
phase. The grounding index must expose exact paths and best-effort symbols from an observation
|
||||
recorded at plan time. If the index cannot prove an assumption, the outcome is `unknown`, never
|
||||
`present`.
|
||||
|
||||
The phase emits a `PlanGroundingEvaluated` observation containing the plan identity, workspace state
|
||||
key, findings, and verdict (`pass`, `return_to_architect`, or `clarification_required`). A non-pass
|
||||
verdict prevents the plan lock; the architect receives compact findings and produces a new plan.
|
||||
That makes a doomed scaffold fail at stage 0 rather than after downstream files accumulate.
|
||||
|
||||
## Seam 2: verified increments in the orchestrator
|
||||
|
||||
For a stage with declared writes, the stage-success path is:
|
||||
|
||||
```text
|
||||
write/tool evidence → contract/static checks → selected build/test command
|
||||
→ WorkspaceVerificationObserved(pass, stateKey) → transition to next implementation stage
|
||||
```
|
||||
|
||||
On a failed command, missing prerequisite, or state-key mismatch:
|
||||
|
||||
```text
|
||||
WorkspaceVerificationObserved(fail/unavailable, evidence)
|
||||
→ retry feedback to owner → no-progress recovery arbiter → terminal failure only after escalation
|
||||
```
|
||||
|
||||
The selected command is deterministic from the stage's `buildExpectation`, the bound project
|
||||
profile, and the recorded prerequisite classification. The model cannot choose a shell command as
|
||||
the truth test. `setup` may run only when configured by the operator and is recorded separately;
|
||||
its success is not itself a green verification result.
|
||||
|
||||
The next-stage context receives a compact `verified baseline` entry: state key, verified command,
|
||||
and changed paths. It must not receive a claim that a skipped/deferred compiler assertion passed.
|
||||
If the stage's workspace changed after verification, the baseline is invalid and the next stage must
|
||||
re-observe/verify before treating it as known-good.
|
||||
|
||||
## Early precondition signals
|
||||
|
||||
`REFERENCE_EXISTS` and similar intent-plane blocks are observations, not disposable ReAct errors.
|
||||
Repeated blocks for one build-critical path become a `workspace_precondition` failure with the path
|
||||
and attempts recorded. The recovery owner either creates the necessary bootstrap/configuration, or
|
||||
routes to clarification when the authoritative intent cannot decide whether that path should exist.
|
||||
This is an early warning; the per-stage verification remains the final truth check.
|
||||
|
||||
## Increment sequence
|
||||
|
||||
1. **#162 — per-write verification:** compiler assertions render as deferred/skipped and
|
||||
write-declaring stages run their configured deterministic gate.
|
||||
2. **#163 — consume repeated hard blockers:** promote repeated build-critical missing paths into
|
||||
recovery-eligible precondition failures.
|
||||
3. **Grounding index and phase:** record an exact path/symbol/prerequisite snapshot, evaluate the
|
||||
compiled plan against it, and prevent a non-grounded plan from locking.
|
||||
4. **Verification invariant:** bind command results to workspace state keys; inject the recorded
|
||||
verified baseline into subsequent implementation stages.
|
||||
5. **#165 — no-progress recovery:** preserve intent-holder escalation for an increment that still
|
||||
cannot become verified.
|
||||
|
||||
## Non-goals
|
||||
|
||||
- Do not use semantic L3 retrieval as a plan-grounding oracle.
|
||||
- Do not silently synthesize ecosystem-specific manifests from a failed command.
|
||||
- Do not rerun commands, inspect the filesystem, or reconstruct verification during replay.
|
||||
- Do not make a terminal verifier the first build truth check for a multi-stage implementation run.
|
||||
@@ -0,0 +1,15 @@
|
||||
# Stage prompt audit and audition
|
||||
|
||||
## Audit
|
||||
|
||||
Inventory each system-role/context block, its origin, token estimate, and outcome evidence. Remove redundant or stale text before adding rules. Inspect retry feedback separately: only the latest failure belongs in the prompt.
|
||||
|
||||
## Candidate additions
|
||||
|
||||
- Project build manifests, configs, and entry files are normal in-scope setup when required by the authoritative intent.
|
||||
- Resolve a necessary scope edge from the authoritative intent; do not spend turns re-deciding it.
|
||||
- Read/observe before writing and verify before declaring completion.
|
||||
|
||||
## Audition harness
|
||||
|
||||
Run a fixed task and seed through baseline, trimmed, curated-rules, and reworded-scope variants. Record completion, gate pass rate, rejected/wasted tool rounds, retries, token budget use, and context truncation. Choose the smallest variant that improves the 12B results; structural gates remain preferred where a deterministic mechanism exists.
|
||||
@@ -21,6 +21,8 @@ Each TOML file in `workflows/` is a valid workflow loadable by the server. Keep
|
||||
|
||||
- Add a new workflow example when a major new workflow type ships.
|
||||
- Prompts referenced by TOML files go in `workflows/prompts/`.
|
||||
- Freestyle architect prompts specify stage constraints, boundaries, and verification goals; they do not prescribe an exact resulting file list when the authoritative intent leaves implementation details open.
|
||||
- Freestyle discovery emits a structured comprehension brief; the analyst emits the addressable `dod` artifact used as the fixed implementation/review rubric.
|
||||
- Do not add configs/plugins/stages stubs speculatively — populate when there is real content.
|
||||
|
||||
## Verification
|
||||
|
||||
@@ -19,6 +19,11 @@ id = "analysis"
|
||||
schema_path = "schemas/analysis.json"
|
||||
llm_emitted = true
|
||||
|
||||
[[artifacts]]
|
||||
id = "dod"
|
||||
schema_path = "schemas/dod.json"
|
||||
llm_emitted = true
|
||||
|
||||
[[artifacts]]
|
||||
id = "design"
|
||||
schema_path = "schemas/design.json"
|
||||
|
||||
@@ -12,7 +12,7 @@ allowed_tools = ["file_read", "list_dir", "shell"]
|
||||
token_budget = 16384
|
||||
max_retries = 2
|
||||
|
||||
# analyst writes no files, but it owns task framing: task_search/task_context (read-only) find
|
||||
# analyst writes no files, but it owns task framing and the fixed definition of done:
|
||||
# existing work; task_create (T2, approval-gated — a task is an event-log entry, not a file write)
|
||||
# opens a single task; task_decompose (T2, one approval for the whole graph) splits a goal with
|
||||
# dependency seams into parent + DEPENDS_ON-linked children. Either way the analysis names the task
|
||||
@@ -20,7 +20,8 @@ max_retries = 2
|
||||
[[stages]]
|
||||
id = "analyst"
|
||||
prompt = "prompts/analyst_freestyle.md"
|
||||
produces = [{ name = "analysis", kind = "analysis" }]
|
||||
needs = ["discovery"]
|
||||
produces = [{ name = "dod", kind = "dod" }]
|
||||
allowed_tools = ["file_read", "list_dir", "shell", "task_search", "task_context", "task_create", "task_decompose"]
|
||||
token_budget = 16384
|
||||
max_retries = 2
|
||||
@@ -30,7 +31,7 @@ id = "architect"
|
||||
requires_approval = true
|
||||
inject_artifact_kinds = true
|
||||
prompt = "prompts/architect_freestyle.md"
|
||||
needs = ["analysis"]
|
||||
needs = ["dod"]
|
||||
produces = [{ name = "execution_plan", kind = "execution_plan" }]
|
||||
token_budget = 16384
|
||||
max_retries = 2
|
||||
@@ -47,7 +48,7 @@ id = "analyst-to-architect"
|
||||
from = "analyst"
|
||||
to = "architect"
|
||||
condition_type = "artifact_validated"
|
||||
condition_artifact_id = "analysis"
|
||||
condition_artifact_id = "dod"
|
||||
|
||||
[[transitions]]
|
||||
id = "architect-to-done"
|
||||
|
||||
@@ -1,33 +1,35 @@
|
||||
You are the **Analyst** in freestyle mode. Understand the user's goal (in the decision history
|
||||
above) and the code it touches. Read-only: `file_read` (also lists a directory's entries when
|
||||
given a directory path), `ls`, `grep`, `cat`, `find`.
|
||||
You are the **Analyst** in freestyle mode. Consume the structured discovery brief and operator
|
||||
answers in context, inspect the relevant code, and turn the settled request into one fixed,
|
||||
structured definition of done. Read-only tools: `file_read`, `list_dir`, `shell`, `task_search`,
|
||||
and `task_context`.
|
||||
|
||||
Before deriving requirements, check for existing work: `task_search` for related, duplicate, or
|
||||
blocking tasks and `task_context` to load any the goal names. Fold what you find into the
|
||||
analysis rather than re-deriving it; flag a duplicate instead of restating it.
|
||||
Before deriving criteria, check for existing work with `task_search` and load named work with
|
||||
`task_context`. Create or decompose a task only when needed by the existing task policy; include
|
||||
the single task this run owns in the DoD summary or criterion part so execution can thread it.
|
||||
|
||||
Then frame the work as a task (per the task policy):
|
||||
- If a task already covers this work, name its id (e.g. `auth-142`) in the analysis.
|
||||
- If the goal is a single coherent unit one run can carry to review, `task_create` one and name its
|
||||
id.
|
||||
- If the goal has **dependency seams** (a thing that must land before another) or **independent
|
||||
review/handoff points** (a piece worth shipping or reviewing on its own), `task_decompose` it into
|
||||
a parent epic + `DEPENDS_ON`-linked children — one approval for the whole graph. A session works
|
||||
one task at a time, so the children are claimed by *later* runs as they unblock; don't over-split.
|
||||
- After decomposing, **name in the analysis the single task this run will work** — the one already
|
||||
ready (no unmet dependency, e.g. the scaffold). Leave the blocked siblings for future runs.
|
||||
Emit the `dod` artifact once. Its criteria are the complete acceptance contract for this run:
|
||||
|
||||
Either way later stages thread the named task through the plan; the rest wait to be claimed.
|
||||
- Give every criterion a stable id (`c1`, `c2`, …), a checkable statement, and its feature area.
|
||||
- Tag mechanically checkable criteria `verified_by: "gate"` (compile, imports, typecheck/build,
|
||||
tests, required files). The reviewer must not adjudicate these.
|
||||
- Tag semantic or UX criteria `verified_by: "reviewer"`.
|
||||
- Copy discovery `brief.non_goals` into `out_of_scope`; this is a hard review boundary.
|
||||
- Cover the entire in-scope brief now. Later stages may not silently add criteria.
|
||||
|
||||
Produce the `analysis` artifact by calling the **`emit_artifact`** tool with these fields:
|
||||
- `summary`: the goal in your own words.
|
||||
- `requirements`: concrete, checkable requirements, one per line.
|
||||
- `affected_areas`: files/modules likely involved, one per line.
|
||||
Call `emit_artifact` with a JSON object matching this shape:
|
||||
`{"summary": string, "criteria": [{"id": string, "statement": string, "part": string,
|
||||
"verified_by": "gate" | "reviewer"}], "out_of_scope": [string]}`.
|
||||
|
||||
Call `emit_artifact` once you have read enough — do not write the JSON as a plain message.
|
||||
Example:
|
||||
```json
|
||||
{
|
||||
"summary": "Deliver the bounded validation gate for task gate-42.",
|
||||
"criteria": [
|
||||
{"id":"c1","statement":"The project typecheck passes before completion","part":"terminal gate","verified_by":"gate"},
|
||||
{"id":"c2","statement":"The operator sees the recorded diagnostic","part":"workflow UX","verified_by":"reviewer"}
|
||||
],
|
||||
"out_of_scope": ["Changing the workflow topology"]
|
||||
}
|
||||
```
|
||||
|
||||
Always produce the analysis — this is your single exit. Open questions and operator forks are the
|
||||
**Discovery** stage's job, and it has already run before you: any ambiguity or contradiction the
|
||||
user needed to resolve was raised and answered upstream, and those answers are in the decision
|
||||
history above. Treat the request as settled, ground your requirements in what you actually read,
|
||||
and do not ask the user anything. Do not design or plan yet.
|
||||
Do not ask questions; discovery owns clarification. Do not design or implement.
|
||||
|
||||
Some files were not shown because too many files have changed in this diff Show More
Reference in New Issue
Block a user