SPB Git forge

spb/rareindex

Public
54commits 1branches 0releases
7.1 MBsize
maindefault branch
10 days agolast push
TypeScript 61.9% HTML 37.2% SQL 0.7%
6.2 KB · 68 lines json
Raw Blame History
1{2  "id": "ebay-browse",3  "displayName": "eBay Browse API (live listings, 6 marketplaces) — gated",4  "sourceId": "ebay",5  "sourceName": "eBay",6  "sourceType": "marketplace",7  "sourceUrl": "https://www.ebay.com",8  "module": "api/ebay-browse",9  "enginePriority": ["api"],10  "categories": ["pokemon", "magic_the_gathering", "yugioh", "sports_cards", "baseball_cards", "basketball_cards", "football_cards", "hockey_cards", "soccer_cards", "comics", "video_games", "sneakers", "watches", "rolex", "omega", "other_watches", "lego_sets", "funko", "coins", "banknotes", "stamps", "music", "cameras", "pens", "whisky", "action_figures", "vintage_toys", "luxury_handbags"],11  "regions": ["US", "CA", "GB", "DE", "FR", "AU"],12  "languages": ["en", "de", "fr"],13  "currency": ["USD", "CAD", "GBP", "EUR", "AUD"],14  "supportsListings": true,15  "supportsSold": false,16  "supportsAuctions": false,17  "supportsImages": true,18  "supportsCatalog": false,19  "supportsPopulation": false,20  "supportsLookup": true,21  "refreshFrequencyMinutes": 60,22  "priority": "high",23  "trustScore": 0.85,24  "attributionRequired": true,25  "termsUrl": "https://developer.ebay.com/join/api-license-agreement",26  "acquisitionMethod": "official API (OAuth2 client credentials)",27  "historicalDepth": "none",28  "requires": ["EBAY_CLIENT_ID", "EBAY_CLIENT_SECRET"],29  "accessNotes": "Official eBay Buy → Browse API v1 (developer.ebay.com/api-docs/buy/browse). Auth: OAuth2 client-credentials grant — POST https://api.ebay.com/identity/v1/oauth2/token with Basic base64(client_id:client_secret), body grant_type=client_credentials&scope=https://api.ebay.com/oauth/api_scope; the application token (expires_in ≈ 7200 s) is cached inside the connector and refreshed 60 s before expiry. Data: GET /buy/browse/v1/item_summary/search with q / category_ids / filter (buyingOptions:{FIXED_PRICE|AUCTION|BEST_OFFER}, conditions, price:[..],priceCurrency, itemLocationCountry…) / sort=newlyListed / limit ≤ 200 / offset (offset+limit ≤ 10,000 per query), one call per (query × marketplace × page); the X-EBAY-C-MARKETPLACE-ID header selects EBAY_US, EBAY_CA, EBAY_GB, EBAY_DE, EBAY_FR or EBAY_AU and prices come back in the marketplace currency (convertedFromCurrency is recorded when eBay converted). Fields kept: itemId (v1|…|0), legacyItemId, epid (eBay product id → identifiers.ebay_epid), title, price/currentBidPrice, bidCount, buyingOptions, condition/conditionId, images, seller username + feedback percentage/score (public marketplace reputation, no personal data), shippingOptions[0].shippingCost, itemLocation city/state/country, itemCreationDate, itemEndDate, categories, watchCount. Limits: Browse is a 'Buy' API — default 5,000 calls/day per application for new keysets, more after eBay's Application Growth Check; we use 1 page per query per hourly run (≤ 6 queries × 6 marketplaces) and back off on 429 through the HTTP engine. IMPORTANT: the Browse API exposes LIVE listings only — there is no sold/completed-item data; eBay's sold data lives in the Marketplace Insights API (limited release, business approval required) and in the deprecated Finding API's findCompletedItems (retired) — documented, not implemented. Credentials: create a developer account at https://developer.ebay.com, an application keyset (production), and for Buy APIs complete the 'Buy API access' application; set EBAY_CLIENT_ID (App ID) and EBAY_CLIENT_SECRET (Cert ID); EBAY_ENV=sandbox switches to api.sandbox.ebay.com. Until the keys exist the framework reports this connector DISABLED (requires) and the crawler exits with a missing_credentials anomaly. Category ids in config are the public eBay leaf categories used in the query seeds; verify/adjust them with the Taxonomy API once a key is available (invalid ids raise error 12000 → page_fetch_failed anomaly). eBay API License Agreement: attribution + no storing of data beyond the permitted caching windows for listing data — RareIndex stores asking prices as listings and links back to itemWebUrl.",30  "enabled": true,31  "schemaVersion": "1.0",32  "config": {33    "limit": 200,34    "pagesPerQuery": 1,35    "backfillPages": 10,36    "queriesPerRun": 6,37    "sort": "newlyListed",38    "defaultFilter": "buyingOptions:{FIXED_PRICE|AUCTION|BEST_OFFER}",39    "marketplaces": [40      { "id": "EBAY_US", "currency": "USD", "country": "US", "locale": "en-US" },41      { "id": "EBAY_CA", "currency": "CAD", "country": "CA", "locale": "en-CA" },42      { "id": "EBAY_GB", "currency": "GBP", "country": "GB", "locale": "en-GB" },43      { "id": "EBAY_DE", "currency": "EUR", "country": "DE", "locale": "de-DE" },44      { "id": "EBAY_FR", "currency": "EUR", "country": "FR", "locale": "fr-FR" },45      { "id": "EBAY_AU", "currency": "AUD", "country": "AU", "locale": "en-AU" }46    ],47    "queries": [48      { "q": "pokemon psa 10", "categoryIds": ["183454"], "categorySlug": "pokemon" },49      { "q": "pokemon charizard", "categoryIds": ["183454"], "categorySlug": "pokemon" },50      { "q": "magic the gathering foil", "categoryIds": ["183454"], "categorySlug": "magic_the_gathering" },51      { "q": "yu-gi-oh 1st edition", "categoryIds": ["183454"], "categorySlug": "yugioh" },52      { "q": "rookie psa", "categoryIds": ["261328"], "categorySlug": "sports_cards" },53      { "q": "cgc 9.8", "categoryIds": ["63"], "categorySlug": "comics" },54      { "q": "sealed wata", "categoryIds": ["139973"], "categorySlug": "video_games" },55      { "q": "air jordan 1 retro high og", "categoryIds": ["15709"], "categorySlug": "sneakers" },56      { "q": "rolex submariner", "categoryIds": ["31387"], "categorySlug": "rolex" },57      { "q": "omega speedmaster", "categoryIds": ["31387"], "categorySlug": "omega" },58      { "q": "lego sealed retired", "categoryIds": ["19006"], "categorySlug": "lego_sets" },59      { "q": "funko pop chase", "categoryIds": ["149372"], "categorySlug": "funko" },60      { "q": "pcgs ms", "categoryIds": ["11116"], "categorySlug": "coins" },61      { "q": "leica m3", "categoryIds": ["15230"], "categorySlug": "cameras" },62      { "q": "montblanc 149", "categoryIds": ["7275"], "categorySlug": "pens" },63      { "q": "first pressing vinyl", "categoryIds": ["176985"], "categorySlug": "music" },64      { "q": "hermes birkin", "categoryIds": ["169291"], "categorySlug": "luxury_handbags" }65    ]66  }67}68