SPB Git forge

spb/rareindex

Public
54commits 1branches 0releases
7.1 MBsize
maindefault branch
10 days agolast push
TypeScript 61.9% HTML 37.2% SQL 0.7%
2.2 KB

# Livestock connector (livestock)

  • Source: https://www.deadstock.ca · dealer · CA · CAD · Shopify storefront
  • Acquisition: public /collections/<handle>/products.json?limit=250&page=N (shared ShopifyStoreConnector adapter wrapped by MarketPinnedShopifyConnector, which adds a localization=CA cookie so Shopify Markets never geo-converts prices; no store-specific code)
  • Records: listing (asking prices, one per variant; out-of-stock variants → ended)
  • Refresh: every 24 h (NORMAL, small catalogue) · history: none (listings only)

Canadian sneaker boutique (Livestock, deadstock.ca). Shopify storefront; sizes as variants with structured SKU (style|colour|size). Retail asks, not resale.

# Collections → taxonomy

collection handle category brand / franchise / series
footwear sneakers —
footwear-adidas adidas_yeezy adidas
footwear-jordan nike_jordan Jordan
footwear-asics new_balance_asics_other ASICS
footwear-converse new_balance_asics_other Converse

Rules (first match wins, applied to "title | product_type | tags | collection"):

  • \b(air )?jordan\b|\bnike\b → nike_jordan
  • \badidas\b|\byeezy\b → adidas_yeezy
  • new balance|\basics\b|\bsalomon\b|\bhoka\b|\bpuma\b|\breebok\b|\bsaucony\b|\bconverse\b|\bvans\b|\bon running\b|\bmizuno\b → new_balance_asics_other

Excluded (regex): gift card|^[^|]*\|(?![^|]*Footwear \|)[^|]*\||birkenstock|\bsandals?\b|\bslides?\b|\bclogs?\b|\bmules?\b|\bloafers?\b|\bboots?\b|\bugg\b|\bcrocs\b|\bsocks?\b|\blaces\b|insoles?|cleaner|shoe trees?

# Access & compliance

See accessNotes in meta.json: robots.txt verified 2026-09-08 (standard Shopify rules, products.json paths allowed), honest UA, 1 req / 1.5 s, listings only, no personal data. Not fetched: apparel, accessories (G-Shock, headwear, bags), lifestyle/home goods; non-sneaker footwear is dropped by the exclude regex (sandals, Birkenstock, boots).

# Fixtures & tests

data/fixtures/livestock/ — live captures (pnpm tsx connectors/api/_g3-shops-na-lib/capture.ts livestock), trimmed single-product payloads incl. a sold-out variant. pnpm vitest run connectors/api/livestock · live probe: pnpm tsx connectors/api/_g3-shops-na-lib/probe.ts livestock.