registry: wave 2 breadth fragments 47–55 — open-source long tail, SaaS status pages & changelogs, EDGAR issuers, Federal Register agencies, cities/regions/public bodies, world governments & regulators, corporate pricing/legal/careers, sports clubs/entertainment/education, media long tail & think tanks (5 669 orgs / 10 969 validated sensors); generators, cross-fragment extends, polygon.io OpenAPI reattributed, YAML boolean country fix, docs
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
10 changed files +19,963 −11
modified
.gitignore
+2 −0
@@ -15,3 +15,5 @@ data/ | |||||
| 15 | qa/test-results/ | 15 | qa/test-results/ | ||
| 16 | qa/.e2e-* | 16 | qa/.e2e-* | ||
| 17 | apps/web/next-env.d.ts | 17 | apps/web/next-env.d.ts | ||
| 18 | +__pycache__/ | ||||
| 19 | +*.pyc | ||||
modified
CLAUDE.md
+4 −1
@@ -57,7 +57,10 @@ is the working guide for the code (v0.2, 2026-09-11). | |||||
| 57 | - `config/sources.yaml` (founding registry) + `config/sources.d/*.yaml` fragments merged in file-name order | 57 | - `config/sources.yaml` (founding registry) + `config/sources.d/*.yaml` fragments merged in file-name order | ||
| 58 | (`extend: true` adds to an earlier source). Fragments 10–35 = site classes; **40–46 (2026-09-11)** = depth: AI | 58 | (`extend: true` adds to an earlier source). Fragments 10–35 = site classes; **40–46 (2026-09-11)** = depth: AI | ||
| 59 | frontier, cloud infrastructure, cybersecurity, finance & markets, governments, science & health, transport / | 59 | frontier, cloud infrastructure, cybersecurity, finance & markets, governments, science & health, transport / | ||
| 60 | − telecom / sports / news. Seeds may carry `country:` (ISO-2, `EU`, `INT`), `language:` and `first_party: false` | 60 | + telecom / sports / news; **47–54 (2026-09-11, wave 2)** = breadth: open-source long tail, SaaS status/changelogs, | ||
| 61 | + EDGAR issuers, Federal Register agencies, cities/regions/public bodies, world governments & regulators, | ||||
| 62 | + corporate pricing/legal/careers pages, sports clubs/entertainment/education, media long tail & think tanks | ||||
| 63 | + (generators `scripts/gen-*.py`, `scripts/prune-fragment.py`). Seeds may carry `country:` (ISO-2, `EU`, `INT`), `language:` and `first_party: false` | ||||
| 61 | (media). Guide: `docs/registry/AUTHORING.md`. Validator: `node node_modules/tsx/dist/cli.mjs | 64 | (media). Guide: `docs/registry/AUTHORING.md`. Validator: `node node_modules/tsx/dist/cli.mjs | ||
| 62 | apps/engine/src/validate.ts <fragment> [--all] [--json report.json]` — nothing enters the registry without OK. | 65 | apps/engine/src/validate.ts <fragment> [--all] [--json report.json]` — nothing enters the registry without OK. | ||
| 63 | 66 | ||||
modified
README.md
+8 −5
@@ -9,7 +9,7 @@ Real-time Internet change intelligence — <a href="https://www.websensor.io">ww | |||||
| 9 | 9 | ||||
| 10 | <p align="center"> | 10 | <p align="center"> | ||
| 11 | <img src="docs/brand/websensor-mark.svg" alt="" width="28" valign="middle"> | 11 | <img src="docs/brand/websensor-mark.svg" alt="" width="28" valign="middle"> | ||
| 12 | − 3 167 organizations · 7 066 active sensors · 16 connector families · 94 event classes · immutable evidence · live WebSocket feed | 12 | + 5 669 organizations · 10 969 validated sensors · 16 connector families · 94 event classes · immutable evidence · live WebSocket feed | ||
| 13 | </p> | 13 | </p> | ||
| 14 | 14 | ||||
| 15 | --- | 15 | --- | ||
@@ -216,10 +216,13 @@ The registry is declarative YAML, merged in file-name order by `apps/engine/src/ | |||||
| 216 | documents & data); | 216 | documents & data); | ||
| 217 | - `config/sources.d/40–46` — **depth** fragments (AI frontier, cloud infrastructure, cybersecurity, finance & | 217 | - `config/sources.d/40–46` — **depth** fragments (AI frontier, cloud infrastructure, cybersecurity, finance & | ||
| 218 | markets, governments incl. Canadian provinces, science & health, transport / telecom / sports / world news); | 218 | markets, governments incl. Canadian provinces, science & health, transport / telecom / sports / world news); | ||
| 219 | −- `config/sources.d/47+` — the long tail (open-source projects, SaaS status pages and changelogs, S&P 500 / | 219 | +- `config/sources.d/47–55` — **breadth** fragments, wave 2 (2026-09-11): the open-source long tail (482 sensors), | ||
| 220 | − Nasdaq-100 / TSX 60 EDGAR issuers and 160 US federal agencies via the Federal Register API, cities and regions, | 220 | + SaaS status pages and changelogs (923, incl. 208 new status sensors), 424 more EDGAR issuers, 184 US federal | ||
| 221 | − world governments and regulators, corporate pricing / legal / leadership pages, sports teams, entertainment, | 221 | + agencies via the Federal Register API, cities / regions / public bodies (356), world governments and regulators | ||
| 222 | − education, regional media, trade press, think tanks). | 222 | + in 55 countries (535), the corporate pricing / legal / careers "silent change" surface of ~250 companies (702), | ||
| 223 | + sports clubs / entertainment / education (396), regional media / trade press / think tanks in 68 countries (638), | ||||
| 224 | + and a small cross-fragment `extend` file. Every sensor was validated live before entering the registry; the | ||||
| 225 | + fragment headers record what was probed and blocked (WAF, JS shells, broken TLS chains). | ||||
| 223 | 226 | ||||
| 224 | ```yaml | 227 | ```yaml | ||
| 225 | sources: | 228 | sources: | ||
modified
config/sources.d/33-openapi.yaml
+0 −5
@@ -98,11 +98,6 @@ sources: | |||||
| 98 | categories: [api] | 98 | categories: [api] | ||
| 99 | sensors: | 99 | sensors: | ||
| 100 | - { name: api openapi spec, url: "https://raw.githubusercontent.com/ollama/ollama/main/docs/openapi.yaml", type: JSON, connector: openapi, tier: C, config: { docsUrl: "https://github.com/ollama/ollama/blob/main/docs/api.md" } } | 100 | - { name: api openapi spec, url: "https://raw.githubusercontent.com/ollama/ollama/main/docs/openapi.yaml", type: JSON, connector: openapi, tier: C, config: { docsUrl: "https://github.com/ollama/ollama/blob/main/docs/api.md" } } | ||
| 101 | − - id: polygon | ||||
| 102 | − extend: true | ||||
| 103 | − categories: [api] | ||||
| 104 | − sensors: | ||||
| 105 | − - { name: api openapi spec, url: "https://api.polygon.io/openapi", type: JSON, connector: openapi, tier: C, config: { docsUrl: "https://polygon.io/docs" } } | ||||
| 106 | - id: google-developers-ai | 101 | - id: google-developers-ai | ||
| 107 | extend: true | 102 | extend: true | ||
| 108 | categories: [api] | 103 | categories: [api] | ||
added
config/sources.d/47-open-source-long-tail.yaml
+4462 −0
Large diff (4,462 lines) is not loaded by default to keep the page fast.Load diff
added
config/sources.d/48-saas-status-changelogs.yaml
+4166 −0
Large diff (4,166 lines) is not loaded by default to keep the page fast.Load diff
added
config/sources.d/49-edgar-issuers.yaml
+4878 −0
Large diff (4,878 lines) is not loaded by default to keep the page fast.Load diff
added
config/sources.d/49b-us-agencies-fedreg.yaml
+1564 −0
Large diff (1,564 lines) is not loaded by default to keep the page fast.Load diff
added
config/sources.d/50-cities-regions-public-bodies.yaml
+2861 −0
Large diff (2,861 lines) is not loaded by default to keep the page fast.Load diff
added
config/sources.d/51-world-governments-regulators.yaml
+2018 −0
Large diff (2,018 lines) is not loaded by default to keep the page fast.Load diff
Diff truncated — file too large.