SPB Git forge
38commits 1branches 0releases
338.7 MBsize
maindefault branch
2 h agolast push
HTML 53.9% TypeScript 44.5% JavaScript 0.6% SQL 0.5%
2.5 KB · 57 lines yaml
Raw Blame History
1# STACK Infrastructure — campus pages (campus + building records) + news/press feed2id: stack3name: STACK Infrastructure4domain: www.stackinfra.com5kind: operator6mode: hybrid7priority: 18license: "Publicly accessible operator pages; factual data only; © STACK Infrastructure"9attribution: "STACK Infrastructure"10homepage: https://www.stackinfra.com/locations/11notes: >12  Open WordPress site. Yoast sitemaps: campuses-sitemap.xml (/locations/<region>/<metro>/<code>/), location-sitemap.xml13  (metro indexes), news-sitemap.xml; RSS at /feed/. Campus pages publish campus MW + acreage and a card per building14  (code, SQ FT, MW). No street address or coordinates. The parser emits one campus record plus one record per building15  (campusName = STACK <code>). Japanese pages under /japan/ are excluded (duplicates of KIX01/TKY01).16  robots.txt has no disallows.17  maxLevel is capped at 2 (direct HTTP only): every stackinfra.com page embeds Cloudflare's "/cdn-cgi/challenge-platform/"18  beacon, which the shared looksBlockedOrEmpty() heuristic misreads as a bot wall and would escalate each of the ~5019  campus pages to Scrapfly (30 credits each) although direct fetches return the full page (HTTP 200, verified).20coverage: { global: true, operators: ["STACK Infrastructure"] }21fetch:22  level: 123  maxLevel: 224  rpm: 2025  concurrency: 226  respectRobots: true27  maxCreditsPerRun: 4028discovery:29  sitemap: ["/campuses-sitemap.xml", "/news-sitemap.xml"]30  rss: ["/feed/"]31  include: ["/locations/", "/about/news-press/"]32  exclude: ["\\?", "/japan/", "/take-a-tour", "/about/news-press/?$"]33  classify:34    - { pattern: "/locations/(americas|emea|asia-pacific)/[a-z-]+/[a-z0-9-]+/?$", group: facility_pages, pageType: facility_page, priority: 60 }35    - { pattern: "/locations/(americas|emea|asia-pacific)/[a-z-]+/?$", group: index, pageType: facility_index, priority: 20 }36    - { pattern: "/locations/?$", group: index, pageType: facility_index, priority: 10 }37    - { pattern: "/about/news-press/(press-releases|news)/[a-z0-9._%-]+/?$", group: newsroom, pageType: press_release, priority: 70 }38  maxUrlsPerRun: 100039schedule:40  facility_pages: weekly41  newsroom: daily42  index: monthly43  sitemap: weekly44  rss: daily45extractors:46  campus:47    # selected by URL only (classifyPage() may mislabel deep facility URLs; the URL is authoritative)48    match: ["/locations/(americas|emea|asia-pacific)/[a-z-]+/[a-z0-9-]+/?$"]49    kind: facility50    parser: stack_campus_v151defaults:52  operatorName: STACK Infrastructure53  operatorKind: developer54  facilityType: wholesale55  isHyperscale: true56parserVersion: v157