SPB Git forge
38commits 1branches 0releases
338.7 MBsize
maindefault branch
3 h agolast push
HTML 53.9% TypeScript 44.5% JavaScript 0.6% SQL 0.5%
2.0 KB · 53 lines yaml
Raw Blame History
1# CoreSite (American Tower) — facility pages with schema.org DataCenter JSON-LD + news RSS2id: coresite3name: CoreSite4domain: www.coresite.com5kind: operator6mode: hybrid7priority: 18license: "Publicly accessible operator pages; factual data only; © CoreSite, an American Tower company"9attribution: "CoreSite"10homepage: https://www.coresite.com/data-centers/locations11notes: >12  Open HubSpot site, single sitemap.xml. Facility URLs: /data-center/<code>-<city>-<st> (29 sites) with a13  schema.org "DataCenter" JSON-LD carrying PostalAddress + GeoCoordinates; spec tabs give square footage,14  certifications, utility provider; cloud on-ramps and peering exchanges are named in the text.15  Metro pages /data-center-locations/<metro> are indexes. RSS: /news/rss.xml.16  robots.txt disallows HubSpot preview/preference paths only.17coverage: { countries: ["US"], operators: ["CoreSite"] }18fetch:19  level: 120  maxLevel: 421  rpm: 2022  concurrency: 223  respectRobots: true24  maxCreditsPerRun: 4025  maxCreditsPerDay: 120   # premium credits per UTC day for this connector (all runs, all workers)26discovery:27  sitemap: true28  rss: ["/news/rss.xml"]29  include: ["/data-center/", "/data-center-locations/", "/news/"]30  exclude: ["\\?", "/news/?$", "/_hcms/", "/hs/"]31  classify:32    - { pattern: "/data-center/[a-z]{2}\\d{1,2}-[a-z0-9-]+$", group: facility_pages, pageType: facility_page, priority: 60 }33    - { pattern: "/data-center-locations/[a-z0-9-]+$", group: index, pageType: facility_index, priority: 20 }34    - { pattern: "/news/[a-z0-9-]+$", group: newsroom, pageType: press_release, priority: 70 }35  maxUrlsPerRun: 100036schedule:37  facility_pages: weekly38  newsroom: daily39  index: monthly40  sitemap: weekly41  rss: daily42extractors:43  facility:44    # selected by URL only (classifyPage() may mislabel deep facility URLs; the URL is authoritative)45    match: ["/data-center/[a-z]{2}\\d{1,2}-[a-z0-9-]+$"]46    kind: facility47    parser: coresite_facility_v148defaults:49  operatorName: CoreSite50  operatorKind: colocation51  facilityType: colocation52parserVersion: v153