SPB Git forge
38commits 1branches 0releases
338.7 MBsize
maindefault branch
3 h agolast push
HTML 53.9% TypeScript 44.5% JavaScript 0.6% SQL 0.5%
2.8 KB

# coresite — CoreSite (American Tower) facilities

Config config/connectors/coresite.yaml
Parser apps/worker/src/connectors/operators1/coresite.ts → coresite_facility_v1
Kind / priority operator / 1
License / attribution Publicly accessible operator pages; factual data only; © CoreSite, an American Tower company
Cadence facility pages weekly · newsroom daily · index monthly · sitemap weekly

# What is crawled

  • https://www.coresite.com/sitemap.xml (single file, 763 URLs, HubSpot CMS) + RSS /news/rss.xml.
  • Facility pages /data-center/<code>-<city>-<st> (29: AT1/AT2, BO1, CH1/CH2, DC1/DC2, DE1–DE3, LA1–LA3, MI1/MI2, NY1–NY3, OR1, RA1, SV1–SV9, VA1–VA3); metro pages /data-center-locations/<metro> → index; news /news/<slug> → GenericConnector news fallback.
  • robots.txt disallows HubSpot preview/preference paths only.

# Access

Open site, L1 works (0 credits). maxLevel: 4, maxCreditsPerRun: 40.

# Fields (method)

  • schema.org DataCenter JSON-LD on every facility page: name ("CoreSite VA3 Data Center"), description, address (PostalAddress → address, city, regionName, postalCode, countryIso2), geo (GeoCoordinates → exact). Fallback address line from the <h3> "12369 Sunrise Valley Drive, Reston, VA 20191".
  • code ← URL (va3 → VA3).
  • Spec tabs (<strong>LABEL</strong> in one div, value in the next div): "SQUARE FOOTAGE 533,000+" → buildingSqm (49,517 m²); "CERTIFICATIONS SOC 1 Type 2, SOC 2 Type 2, ISO 27001, NIST 800-53, PCI DSS, HIPAA" → certifications; "UTILITY PROVIDER Dominion Energy" → appended to description.
  • cloudProviders ← the "cloud on-ramps" sentence (AWS, Microsoft Azure, Google Cloud, IBM Cloud, Oracle Cloud, Alibaba Cloud…); ixps ← named exchanges in the text (Any2Exchange, LINX NoVA, AMS-IX Chicago, DE-CIX…).
  • No MW figures are published on the pages (the spec sheets are separate PDFs, not crawled) → null.
  • Key coresite:<CODE>; externalIds.coresite_code.

# Verification (2026-09-11)

  • Discovery: 116 URLs → facility_pages=29, newsroom=76, index=11.
  • --url VA3: 12369 Sunrise Valley Drive, Reston, VA 20191, US, geo 38.9515/-77.3751, 49,517 m², 6 certifications, clouds AWS/Azure/Google/Oracle, IX Any2Exchange + LINX NoVA, utility Dominion Energy — matches the live page.
  • --url CH1: 427 S LaSalle Street, Chicago, IL 60605, geo 41.876606/-87.631969, IX Any2Exchange / AMS-IX Chicago / DE-CIX.
  • Sweep of 8 spread pages (AT2, NY3, AT1, MI1, CH1, DE2, VA1, OR1): 8/8 valid, all with address + square footage; 4/8 with JSON-LD coordinates (AT1/AT2/VA1/OR1 pages carry no geo). Newsroom sample 4/4 valid. Credits: 0.

# Gaps / TODO

  • Coordinates only where the JSON-LD includes geo (about half the sites).
  • MW per site not published on HTML pages.