kami
fb1d97058a
First slice of the research workflow: the pure, zero-inference extraction pipeline
that the WebFetchTool will consume. New :infrastructure:research module (jsoup).
HtmlMarkdownExtractor: content-type dispatch (HTML extracted; JSON/text pass
through; binary/media/pdf rejected at the header), then structural strip
(MainContentSelector: drop script/style/nav/footer/aside/form + class/id blocklist)
+ density extraction (text − link-text score, semantic <article>/<main> preferred)
+ DOM→markdown (MarkdownRenderer/Table/Inline: headings, lists incl. nested, tables,
fenced code, blockquotes, links, emphasis). Output below the min-length threshold is
flagged LOW_QUALITY so the workflow can route around dead sources (SPAs, paywalls).
extractorVersion ("html-md-1") is pinned on every result so replay reads recorded
artifacts and never re-extracts — the embedding-hash discipline (§5, ADR-0000 §10).
Next slices: WebFetchTool + egress policy + CAS wiring (emits the fetch +
LowQualityExtraction events), then WebSearchTool/SearXNG, workflow graph, synthesis.
53 lines
1.3 KiB
Groovy
53 lines
1.3 KiB
Groovy
pluginManagement {
|
|
repositories {
|
|
mavenCentral()
|
|
gradlePluginPortal()
|
|
}
|
|
}
|
|
|
|
rootProject.name = 'correx'
|
|
|
|
include ':apps:cli'
|
|
include ':apps:server'
|
|
include ':apps:worker'
|
|
include ':apps:desktop'
|
|
|
|
include ':core:kernel'
|
|
include ':core:events'
|
|
include ':core:transitions'
|
|
include ':core:context'
|
|
include ':core:inference'
|
|
include ':core:artifacts'
|
|
include ':core:artifacts-store'
|
|
include ':core:validation'
|
|
include ':core:approvals'
|
|
include ':core:tools'
|
|
include ':core:toolintent'
|
|
include ':core:router'
|
|
include ':core:sessions'
|
|
include ':core:config'
|
|
include ':core:risk'
|
|
include ':core:journal'
|
|
|
|
include ':infrastructure:persistence'
|
|
include ':infrastructure:inference'
|
|
include ':infrastructure:inference:commons'
|
|
include ':infrastructure:inference:llama_cpp'
|
|
include ':infrastructure:router'
|
|
include ':infrastructure:router:turbovec'
|
|
include ':infrastructure:tools'
|
|
include ':infrastructure:tools:filesystem'
|
|
include ':infrastructure:workflow'
|
|
include ':infrastructure:artifacts-cas'
|
|
include ':infrastructure:research'
|
|
|
|
include ':testing:replay'
|
|
include ':testing:contracts'
|
|
include ':testing:kernel'
|
|
include ':testing:integration'
|
|
include ':testing:fixtures'
|
|
include ':testing:projections'
|
|
include ':testing:transitions'
|
|
include ':testing:approvals'
|
|
include ':testing:deterministic'
|