SPB Git forge

spb/rareindex

Public
54commits 1branches 0releases
7.1 MBsize
maindefault branch
10 days agolast push
TypeScript 61.9% HTML 37.2% SQL 0.7%
4.5 KB · 78 lines json
Raw Blame History
1{2  "id": "the-game-steward",3  "displayName": "The Game Steward (US board-game store, USD)",4  "sourceId": "the-game-steward",5  "sourceName": "The Game Steward",6  "sourceType": "dealer",7  "sourceUrl": "https://www.thegamesteward.com",8  "module": "api/the-game-steward",9  "enginePriority": [10    "api"11  ],12  "categories": [13    "board_games"14  ],15  "regions": [16    "US"17  ],18  "languages": [19    "en"20  ],21  "currency": [22    "USD"23  ],24  "supportsListings": true,25  "supportsSold": false,26  "supportsAuctions": false,27  "supportsImages": true,28  "supportsCatalog": false,29  "supportsPopulation": false,30  "supportsLookup": true,31  "refreshFrequencyMinutes": 720,32  "priority": "medium",33  "trustScore": 0.75,34  "attributionRequired": true,35  "termsUrl": "https://www.thegamesteward.com/policies/terms-of-service",36  "accessNotes": "The Game Steward (thegamesteward.com) runs on Shopify. The connector reads ONLY the public, unauthenticated storefront JSON that every Shopify shop serves to any visitor: /collections/<handle>/products.json?limit=250&page=N for the 4 configured collections (all-kickstarter-exclusive-badge, all-kickstarter-games-all-time, core-games-stand-alone-games, eagle-gryphon-deluxe-kickstarter-games) and /products/<handle>.json for URL lookups (~2.8k Kickstarter board games, 1.5k Kickstarter-exclusive editions). robots.txt (verified 2026-09-08, User-agent *): standard Shopify rules — Disallow /admin, /cart, /checkout(s), /orders, /account, /services, /sf_*, /cart.js, /recommendations/products, /cdn/wpm/*.js and the filter/sort crawl traps (/collections/*sort_by*, /collections/*+*, /collections/*filter*&*filter*); no Crawl-delay for *. The /collections/<handle>/products.json and /products/<handle>.json paths we read carry none of those patterns and are allowed. Sitemap declared at /sitemap.xml (not needed). Access behaviour: plain HTTP 200 JSON with the honest RareIndexBot UA, no anti-bot challenge, no login, no key. Market pinning: Shopify Markets localises products.json prices by the requester IP as soon as an Accept-Language header is present (observed on Markets-enabled shops: a Canadian crawler receives CAD-converted prices with content-language en-CA while the JSON carries no currency field). Every request therefore sends the public localization=US cookie — the shop's own home market, exactly what a US visitor gets — so prices are always the declared USD (verified 2026-09-08: 30.00 vs 43.00 on a Markets shop). Politeness: 1 request per 1.5 s, concurrency 1 per host (connectors/domains.d/g3-shops-na.json), crawlDepth pages per collection per incremental run, backfill bounded by backfillMaxPages. Data: asking prices in USD (the shop's declared currency) — these are LISTINGS, never sales (§111); one listing per variant (condition/size/edition), variant SKU kept as identifier, out-of-stock variants kept as 'ended' listings, 0.00-priced placeholders dropped. Dates: published_at only; no fetch time is ever used as a sale date. Deliberately NOT fetched: cart/checkout/account/customer endpoints, per-product .js barcode enrichment (fetchBarcodes=false: one extra request per product is not worth it for listings), the whole-shop /products.json, and unmapped collections — accessories (play mats, sleeves, inserts, organizers), mechanic/player-count umbrella collections, franchise duplicates. No personal data is collected; seller = the store itself.",37  "enabled": true,38  "schemaVersion": "1.0",39  "acquisitionMethod": "Shopify storefront products.json",40  "historicalDepth": "none",41  "requires": [],42  "config": {43    "currency": "USD",44    "market": "US",45    "seller": "The Game Steward",46    "location": "Georgia, USA",47    "collections": [48      {49        "handle": "all-kickstarter-exclusive-badge",50        "categorySlug": "board_games",51        "series": "Kickstarter Exclusive"52      },53      {54        "handle": "all-kickstarter-games-all-time",55        "categorySlug": "board_games",56        "series": "Kickstarter"57      },58      {59        "handle": "core-games-stand-alone-games",60        "categorySlug": "board_games"61      },62      {63        "handle": "eagle-gryphon-deluxe-kickstarter-games",64        "categorySlug": "board_games",65        "brand": "Eagle-Gryphon Games",66        "series": "Deluxe Kickstarter"67      }68    ],69    "rules": [],70    "defaultCategory": null,71    "exclude": "gift card|mystery|\\| Kickstarter Board Game Accessory \\||play ?mats?|\\bsleeves?\\b|\\binserts?\\b|organizer|\\bshipping\\b|upgrade kit|dice (tower|tray|set|bag)",72    "keepOutOfStock": true,73    "fetchBarcodes": false,74    "wholeShop": false,75    "pageSize": 25076  }77}78