SPB Git forge

spb/rareindex

Public
54commits 1branches 0releases
7.1 MBsize
maindefault branch
10 days agolast push
TypeScript 61.9% HTML 37.2% SQL 0.7%

# yahoo-auctions-jp — Yahoo! Auctions Japan (ヤフオク!)

Live listings and recently closed lots of Japan's largest C2C auction site, in JPY.

  • Acquisition: plain HTTPS with the RareIndexBot UA (Scrapfly country=jp only as fallback).
    • /search/search?p=<kw>[&auccat=<id>][&b=<offset>] → 50 li.Product cards per page (id, title, current price 現在, buy-now 即決, bids, end time, image, category path, 未使用 badge) → listing (auction or fixed price).
    • /closedsearch/closedsearch?p=<kw>[&b=<offset>] → Next.js __NEXT_DATA__ state, 50 ended lots per page → sale when bidCount ≥ 1 (hammer price, no buyer premium, JST end time as saleDate).
    • /jp/auction/<id> only for lookup() (server-rendered pageData).
  • robots.txt: Allow: /closedsearch/closedsearch; n=, mode=, s1=, o1=, min=/max= filters are disallowed → never sent (tested).
  • Seeds: config.seeds = { q, category, language, auccat }; family slugs are refined from the title (ポケモンカード → pokemon, 遊戯王 → yugioh, ロレックス → rolex …). pagesPerSeed live pages, closedPagesPerSeed closed pages; backfill walks closed pages up to backfillMaxPages with progress + cursor.
  • Identity: identifiers.yahoo_auction_id (shared with the aucfree connector so historical and live records merge). PSA/BGS/ARS grades parsed from titles (full-width normalised). Bundles (まとめ売り, N枚セット …) flagged.
  • Not fetched: seller/bidder pages, watchlists, filters, any logged-in page. Seller names are masked by the site and not stored.

Smoke / capture: pnpm tsx connectors/api/_g9-asia-watch-sneaker-lib/capture.ts yahoo-auctions-jp --limit 2 [--seeds 'ロレックス'].