SPB Git forge
38commits 1branches 0releases
338.7 MBsize
maindefault branch
3 h agolast push
HTML 53.9% TypeScript 44.5% JavaScript 0.6% SQL 0.5%
2.8 KB · 36 lines markdown
Rendered Raw Blame History
1# coresite — CoreSite (American Tower) facilities23| | |4|---|---|5| Config | `config/connectors/coresite.yaml` |6| Parser | `apps/worker/src/connectors/operators1/coresite.ts` → `coresite_facility_v1` |7| Kind / priority | operator / 1 |8| License / attribution | Publicly accessible operator pages; factual data only; © CoreSite, an American Tower company |9| Cadence | facility pages weekly · newsroom daily · index monthly · sitemap weekly |1011## What is crawled12- `https://www.coresite.com/sitemap.xml` (single file, 763 URLs, HubSpot CMS) + RSS `/news/rss.xml`.13- Facility pages `/data-center/<code>-<city>-<st>` (29: AT1/AT2, BO1, CH1/CH2, DC1/DC2, DE1–DE3, LA1–LA3, MI1/MI2, NY1–NY3, OR1, RA1, SV1–SV9, VA1–VA3); metro pages `/data-center-locations/<metro>` → `index`; news `/news/<slug>` → GenericConnector news fallback.14- robots.txt disallows HubSpot preview/preference paths only.1516## Access17Open site, L1 works (0 credits). `maxLevel: 4`, `maxCreditsPerRun: 40`.1819## Fields (method)20- schema.org `DataCenter` JSON-LD on every facility page: `name` ("CoreSite VA3 Data Center"), `description`, `address` (PostalAddress → `address`, `city`, `regionName`, `postalCode`, `countryIso2`), `geo` (GeoCoordinates → `exact`). Fallback address line from the `<h3>` "12369 Sunrise Valley Drive, Reston, VA 20191".21- `code` ← URL (`va3` → VA3).22- Spec tabs (`<strong>LABEL</strong>` in one div, value in the next div): "SQUARE FOOTAGE 533,000+" → `buildingSqm` (49,517 m²); "CERTIFICATIONS SOC 1 Type 2, SOC 2 Type 2, ISO 27001, NIST 800-53, PCI DSS, HIPAA" → `certifications`; "UTILITY PROVIDER Dominion Energy" → appended to `description`.23- `cloudProviders` ← the "cloud on-ramps" sentence (AWS, Microsoft Azure, Google Cloud, IBM Cloud, Oracle Cloud, Alibaba Cloud…); `ixps` ← named exchanges in the text (Any2Exchange, LINX NoVA, AMS-IX Chicago, DE-CIX…).24- No MW figures are published on the pages (the spec sheets are separate PDFs, not crawled) → null.25- Key `coresite:<CODE>`; `externalIds.coresite_code`.2627## Verification (2026-09-11)28- Discovery: 116 URLs → `facility_pages=29`, `newsroom=76`, `index=11`.29- `--url` VA3: 12369 Sunrise Valley Drive, Reston, VA 20191, US, geo 38.9515/-77.3751, 49,517 m², 6 certifications, clouds AWS/Azure/Google/Oracle, IX Any2Exchange + LINX NoVA, utility Dominion Energy — matches the live page.30- `--url` CH1: 427 S LaSalle Street, Chicago, IL 60605, geo 41.876606/-87.631969, IX Any2Exchange / AMS-IX Chicago / DE-CIX.31- Sweep of 8 spread pages (AT2, NY3, AT1, MI1, CH1, DE2, VA1, OR1): 8/8 valid, all with address + square footage; 4/8 with JSON-LD coordinates (AT1/AT2/VA1/OR1 pages carry no `geo`). Newsroom sample 4/4 valid. Credits: 0.3233## Gaps / TODO34- Coordinates only where the JSON-LD includes `geo` (about half the sites).35- MW per site not published on HTML pages.36