NEXTDC (nextdc)
- Domain:
www.nextdc.com· Kind: operator · Priority: 1 · Enabled: yes - License / attribution: Publicly accessible operator pages; factual data only; © NEXTDC Limited — attribution “NEXTDC”
- Coverage: AU, NZ, MY, JP
What it collects
Facility records (kind: facility) via parser(s) nextdc_facility_v1 in apps/worker/src/connectors/operators2/apac.ts.
Fields published by the pages and captured: name, code, city, countryIso2, itCapacityMw, buildingSqm (technical space), rackCount, tier, certifications, status.
Every field carries an extraction method in methods (e.g. json-ld:PostalAddress, regex:it_mw_v1, attr:data-value+MW, lookup:city-country) for provenance. Coordinates are only taken from JSON-LD / embedded JSON / map links published by the operator — never geocoded. Status defaults to operational unless the page uses pipeline wording (under construction / coming soon / planned).
Discovery
- Sitemaps:
https://www.nextdc.com/sitemap.xml - Include:
/data-centres/[a-z-]+-data-centres/[a-z]{1,2}\d{1,2}-[a-z-]+$,/news/,/media-releases?/,/newsroom/ - Exclude:
\?,# - Classify:
/data-centres/[a-z-]+-data-centres/[a-z]{1,2}\d{1,2}-[a-z-]+$→ facility_pages (facility_page);/(news|media-releases?|newsroom)/.→ newsroom (press_release)
Newsroom URLs (when configured) rely on the GenericConnector news fallback (press_release → news_event when data-center relevant).
Schedule & fetch
- Schedule: facility_pages weekly, newsroom daily, sitemap weekly
- Fetch: L1→L2, 15 rpm, concurrency 2, robots.txt respected, max 20 premium credits/run. All pages are served at L1 (plain HTTP);
maxLevelis capped at 2 so false-positive “blocked” heuristics (HubSpot / cookie-consent strings) never spend Scrapfly credits.
Quirks
Facility pages /data-centres/-data-centres/- publish IT capacity, technical space, rack capacity, Tier and certifications. robots.txt allows / (HubSpot preview paths excluded).
Verification (live, 2026-09-11)
try-connector --limit N: discovered 128 URLs (newsroom=103, facility_pages=25); sampled pages → 4 entities, 4 valid, 0 rejected, 0 premium credits.