Cross-project capability map

This map groups capabilities by what the software can do, not by repository.

Maturity uses the Product Compass reuse model: local implementation, repeated pattern, documented pattern, extracted component, governed package.

Capability groups

Data ingestion and monitored pipelines

Capability	Summary	Source projects	Maturity	Reuse potential	Likely extraction shape	Products it could help	Evidence status
Monitored source ingestion	Detect source changes, fingerprint inputs, create/resume runs, store artefacts, load warehouse tables, validate, and finalise.	DataStitcher, SiteIntel bulk ingest, BigQuery Atlas	Documented pattern	High	Pattern first, then works-ingest contracts/package	DataStitcher, SiteIntel, BigQuery Atlas, Bollocks Radar, future public-data products	Fact plus inference
Resumable run and checkpoint state	Store run steps, attempts, artefact pointers, retry state, and failed-stage recovery.	DataStitcher, SiteIntel bulk ingest, BigQuery Atlas cataloguer	Repeated pattern	High	Schema pattern, TypeScript contracts, admin UI pattern	Any product doing scheduled data collection	Fact
Source registry	Represent sources, cadence, enabled state, credentials required, table specs, parser type, and downstream outputs.	DataStitcher, SiteIntel bulk ingest, Trackpal provider registry	Repeated pattern	High	Shared source/provider registry contract	Trackpal, SiteIntel, DataStitcher, BigQuery Atlas	Fact plus inference
Raw artefact boundary	Store raw files/payloads in object storage and keep databases limited to summaries, state, and pointers.	DataStitcher, SiteIntel, Bollocks Radar, BigQuery Atlas	Documented pattern	High	Guide plus validation rules	Every ingestion product	Fact

Crawling, discovery, and enrichment

Capability	Summary	Source projects	Maturity	Reuse potential	Likely extraction shape	Products it could help	Evidence status
Evidence-backed candidate discovery	Find candidates only from public evidence, score provenance, dedupe, and cool down repeat attempts.	BigQuery Atlas, DataStitcher public audit, SiteIntel bulk ingest	Documented pattern	High	Pattern plus candidate/evidence schema	BigQuery Atlas, DataStitcher, SiteIntel, public-good tools	Fact
Domain intelligence task registry	Split domain collection into source-specific tasks with TTLs, dependencies, queues, retries, cost tiers, and worker targets.	SiteIntel	Local implementation / documented pattern	High	Shared task registry contract after second consumer	SiteIntel, Trackpal website monitor, future smoke-alarm tool	Fact plus opportunity
Website map analysis	Analyse robots, sitemaps, homepage metadata, schema, auxiliary files, platform hints, and display-friendly insights.	SiteIntel ideas and current task docs	Prototype / local implementation	Medium	Standalone tool or source adapter	SiteIntel, free website smoke-alarm tool, Trackpal agency upsell	Fact plus opportunity
Claim/fact-check ingestion	Query Google Fact Check, normalise reviews, dedupe, cluster claims, track publishers, and record safe fetch attempts.	Bollocks Radar	Local implementation / documented pattern	Medium	Product-local first; source adapter pattern later	Bollocks Radar, public trust widgets, SiteIntel trust signals	Fact

Provider API sync and external integrations

Capability	Summary	Source projects	Maturity	Reuse potential	Likely extraction shape	Products it could help	Evidence status
Read-only business metric sync	Connect provider accounts, fetch top-level metrics, write metric snapshots, and record sync runs.	Trackpal	Local implementation	Medium to high	Connector interface and sync-run pattern	Trackpal, future small-business SaaS products	Fact
Provider rollout registry	Track provider setup status, required config, required secret names, scopes, approval blockers, templates, and metrics.	Trackpal, Meridian Hub, SiteIntel	Repeated pattern	High	Shared contract and admin components	Trackpal, SiteIntel, DataStitcher, Hub	Fact plus inference
Secret presence/status surfaces	Show secret/config status as present/missing/unknown/not expected/stale without exposing values.	Trackpal, Meridian Hub, Meridian deployment/runtime docs	Documented pattern	High	Works admin component plus CLI/runtime helper	Every protected admin surface	Fact
BigQuery metadata sync	Read project, dataset, table, schema, and change metadata from BigQuery APIs or INFORMATION_SCHEMA with bounds.	BigQuery Atlas, SiteIntel BigQuery worker, Meridian works-bigquery-catalogue	Repeated pattern	High	Package or CLI adapter with clear safety docs	BigQuery Atlas, DataStitcher, SiteIntel, Compass generation	Fact

Dashboard, admin UI, and public reporting

Capability	Summary	Source projects	Maturity	Reuse potential	Likely extraction shape	Products it could help	Evidence status
Template-driven scorecards	Render dashboards from template definitions, metric definitions, snapshots, alerts, freshness, and setup prompts.	Trackpal	Local implementation / documented pattern	High	Pattern first, then React view-model package	Trackpal, DataStitcher, admin scoreboards, future SaaS apps	Fact plus opportunity
Evidence-backed story reports	Present deterministic findings in plain English with source evidence and optional technical proof.	SiteIntel, Bollocks Radar	Repeated product pattern	High	Guide plus finding/evidence contracts	SiteIntel, Bollocks Radar, public audit tools	Fact plus inference
Protected admin operations shell	Provide dense operator surfaces for invites, sources, sync runs, provider health, manual actions, and feature flags.	Trackpal, SiteIntel, DataStitcher, BigQuery Atlas, Meridian Hub	Repeated pattern	High	Blueprint first, then component library	Most current products	Fact
Generated docs cockpits	Generate status, operations, deployable-unit, runtime, and live-data docs from checked-in metadata.	Product repos, @meridian-stack/works-docs, Product Compass	Extracted component / governed package for docs	High	Existing package plus product metadata conventions	Every product repo and Product Compass	Fact

Data modelling, registry, and governance

Capability	Summary	Source projects	Maturity	Reuse potential	Likely extraction shape	Products it could help	Evidence status
Semantic metric registry	Define metrics, dimensions, aliases, caveats, external mappings, sensitivity, and publication rules.	DataStitcher, Trackpal	Repeated pattern	High	Registry schema and docs-generation guide	DataStitcher, Trackpal, public data tools	Fact plus inference
Domain registry and Public Suffix List sync	Store canonical domain parts, ICANN/full PSL registrable domains, hierarchy edges, and source sightings.	SiteIntel	Local implementation / prototype docs	High	Package or BigQuery schema template after proof	SiteIntel, Trackpal, domain tools, public audit tools	Fact plus opportunity
Data product separation	Separate platform capabilities, data product config, and public app code.	DataStitcher	Documented pattern	Medium to high	Architecture guide and starter blueprint	DataStitcher, future public-data products	Fact
Privacy and publication policy	Encode whether raw/name-bearing data can be stored or published, including region constraints.	DataStitcher	Documented pattern	Medium	Guide and schema fields	DataStitcher, public audit tools, Bollocks Radar	Fact

AI-agent support and developer intelligence

Capability	Summary	Source projects	Maturity	Reuse potential	Likely extraction shape	Products it could help	Evidence status
AI context pack generation	Generate compact Markdown/JSON context from project facts and synthesis docs.	Product Compass, product docs repos	Local implementation	High	Improved script plus metadata conventions	Product Compass, future AI handoff flows	Fact
Codex session analysis	Parse local Codex JSONL, derive costs/timing/tool timelines, render reports and dashboards, export redacted metrics.	Codex Sessions Analyser	Local implementation	High	Local developer tool, possibly redacted Hub feed	Meridian, Compass, AI-agent workflow improvement	Fact
Repository analysis reports	Run context audit in GitHub Actions, post full/compact reports to Hub, store full reports in R2 and compact summaries in D1.	Meridian Hub	Local implementation / documented pattern	High	Hub feature plus possible Compass input	Meridian Hub, Product Compass, AI onboarding	Fact

First extraction priorities

1. Ingestion contracts: source, run, step, artefact, validation, retry, and status shapes.
2. Admin status components: provider status, secret-status, sync/run summaries, recent failures, manual retry controls.
3. Source/provider registry contract: shared language for enabled state, cadence, credential requirements, scopes, and supported metrics.
4. Domain/Public Suffix List package or blueprint: extract only after SiteIntel and a second consumer need it.
5. Template dashboard renderer: keep Trackpal-local until another product renders from the same config shape.

What should remain local for now

• Bollocks Radar verdict mapping, claim clustering, and exact Google Fact Check ingestion semantics.
• Trackpal live provider connector details and OAuth flows.
• DataStitcher business-specific metrics and ABN publication rules.
• SiteIntel findings copy, competitor interpretation, and paid-source selection.
• BigQuery Atlas scoring heuristics until candidate discovery and validation prove stable under real runs.

Sources consulted

• projects/site-intel/docs/architecture/task-orchestration.mdx
• projects/site-intel/docs/reference/technical/bigquery-domain-registry-and-bulk-ingest.mdx
• projects/data-stitcher/docs/operations/reusable-monitored-ingestion-pattern.md
• projects/data-stitcher/docs/reference/registry/overview.mdx
• projects/bq-atlas/docs/architecture/shared-code-extraction-plan.md
• projects/bq-atlas/services/candidate-crawler/README.md
• projects/bq-atlas/services/public-cataloguer/README.md
• projects/bollocks-radar/docs/reference/technical/google-fact-check-ingestion.mdx
• projects/trackpal/docs/product/07-template-system.md
• projects/trackpal/docs/product/12-integrations-strategy.md
• projects/codex-sessions-analyser/README.md
• docs/architecture/meridian-works-shared-platform.md