Data plane · SourceRegistry

Sources & ingestion

Every source obeys the acquisition-tiering invariant · licensed/API → managed scraper → custom miner · Scout extension only for human-assisted no-API sites · no ToS-hostile scraping

Active sources9across 5 access methods

Tier-2 fail rate4.1%managed scraper · rolling 24h

Batches today214bronze immutable → ADLS

Candidate sources2from discovery agent · await triage

SourceRegistry

9 active

Source	Venue kind	Access method	ToS risk	Status	Effort	Exp. value
eBayapi.ebay.com	marketplace	api	clean	Active	low	high
Mercarimercari.com	marketplace	scraper	gray	Active	med	high
B-Stock liquidationsbstock.com/feed	liquidator	feed	clean	Active	low	high
BookScouterbookscouter.com/api	buyback	api	clean	Active	low	med
Discogsapi.discogs.com	price_guide	api	clean	Active	low	med
Estate-sale directoryno public API · Scout-assisted	marketplace	scout_extension	gray	Active	med	med
GovDeals auctionsgovdeals.com · lot manifests	liquidator	custom_miner	gray	Candidate	high	high
Keepakeepa.com/api · premium €/mo	price_guide	api	clean	Deferred	low	high
BrickLinkbricklink.com/api · needs seller status	marketplace	api	clean	Deferred	med	med

Extraction health by tier

nominal

Tier 1 · structured API / feed99.2% ok

Tier 2 · managed scraper4.1% fail

Tier 3 · Scout extension (human-assist)manual cadence

💡

Tiering holds strictly: a source only drops to a lower tier when the higher one is unavailable. Custom miners run only on sources with no API and no ToS-hostile posture.

Recent ingest batches

bronze immutable · silver rebuildable

batchId	payloadType	records	tier	failures	capturedAt
b-8f21a4	listings	4,120	1	0	10:41
b-8f2199	product-listings	2,884	1	3	10:33
b-8f2170	lot-listings	312	2	0	10:22
b-8f214e	product-sales	1,046	1	1	10:09
b-8f2131	listings	1,970	2	84	09:57
b-8f2108	product-sales	598	1	0	09:44

🗄️

Raw payloads land immutable in bronze (ADLS). The silver layer is fully rebuildable from bronze — reprocessing never re-ingests.

Source discovery agent

Planned

Describe a niche and the agent probes the open web for viable acquisition targets, then emits a Source Dossier (markdown) plus candidate SourceRegistry rows at status=candidate for human triage. v1 will run per active niche on a cadence.

OutputSource Dossier (markdown)

Emitscandidate SourceRegistry rows

Tieringrespects acquisition invariant

Cadence (v1)per active niche