SPB Git forge
38commits 1branches 0releases
338.7 MBsize
maindefault branch
3 h agolast push
HTML 53.9% TypeScript 44.5% JavaScript 0.6% SQL 0.5%
2.0 KB · 53 lines yaml
Raw Blame History
1# CyrusOne — facility pages (HubSpot CMS) + press-release RSS2id: cyrusone3name: CyrusOne4domain: www.cyrusone.com5kind: operator6mode: hybrid7priority: 18license: "Publicly accessible operator pages; factual data only; © CyrusOne LLC"9attribution: "CyrusOne"10homepage: https://www.cyrusone.com/data-centers11notes: >12  Open site (HubSpot). Facility URLs: /data-centers/(north-america|emea|apac)/<slug>; pages publish city/country,13  facility code(s), "N MW Total IT Capacity", technical space and sustainability items — no street address and no14  coordinates (geo left null). Press releases: /resources/press-releases/rss.xml.15  robots.txt disallows HubSpot preview/preference paths only.16coverage: { global: true, operators: ["CyrusOne"] }17fetch:18  level: 119  maxLevel: 420  rpm: 2021  concurrency: 222  respectRobots: true23  maxCreditsPerRun: 4024  maxCreditsPerDay: 120   # premium credits per UTC day for this connector (all runs, all workers)25discovery:26  sitemap: true27  rss: ["/resources/press-releases/rss.xml"]28  include: ["/data-centers/", "/resources/press-releases/"]29  exclude: ["\\?", "#", "back-up-generator-schedule", "/_hcms/", "/hs/"]30  classify:31    - { pattern: "/data-centers/(north-america|emea|apac)/[a-z0-9-]+$", group: facility_pages, pageType: facility_page, priority: 60 }32    - { pattern: "/data-centers/?$", group: index, pageType: facility_index, priority: 10 }33    - { pattern: "/resources/press-releases/[a-z0-9._%-]+$", group: newsroom, pageType: press_release, priority: 70 }34    - { pattern: "/resources/press-releases/?$", group: index, pageType: news_index, priority: 10 }35  maxUrlsPerRun: 100036schedule:37  facility_pages: weekly38  newsroom: daily39  index: monthly40  sitemap: weekly41  rss: daily42extractors:43  facility:44    # selected by URL only (classifyPage() may mislabel deep facility URLs; the URL is authoritative)45    match: ["/data-centers/(north-america|emea|apac)/[a-z0-9-]+$"]46    kind: facility47    parser: cyrusone_facility_v148defaults:49  operatorName: CyrusOne50  operatorKind: colocation51  facilityType: wholesale52parserVersion: v153