SPB Git

spb/rareindex

Public
3.5 KB · 54 lines json
1{2  "id": "peyton-street-pens",3  "displayName": "Peyton Street Pens (vintage & modern pen dealer)",4  "sourceId": "peyton-street-pens",5  "sourceName": "Peyton Street Pens",6  "sourceType": "dealer",7  "sourceUrl": "https://www.peytonstreetpens.com",8  "module": "api/peyton-street-pens",9  "enginePriority": ["api"],10  "categories": ["pens", "lighters"],11  "regions": ["US"],12  "languages": ["en"],13  "currency": ["USD"],14  "supportsListings": true,15  "supportsSold": false,16  "supportsAuctions": false,17  "supportsImages": true,18  "supportsCatalog": false,19  "supportsPopulation": false,20  "supportsLookup": false,21  "refreshFrequencyMinutes": 1440,22  "priority": "low",23  "trustScore": 0.75,24  "attributionRequired": true,25  "termsUrl": "https://www.peytonstreetpens.com/store-policies/",26  "acquisitionMethod": "public HTML (BigCommerce category grid cards)",27  "historicalDepth": "none",28  "accessNotes": "Peyton Street Pens (Santa Cruz, California; large restored-vintage and new fountain-pen inventory) runs on BigCommerce, which has no public products JSON; the category pages (/<category>/?page=N, 24 cards) are server-rendered and each <li class=\"product\"> card exposes the product URL, title (model, era, colour, nib, condition in parentheses), SKU, brand link, price (USD, 'price--withoutTax') and the cdn11.bigcommerce.com image. We read only those category pages for the configured vintage/collectible categories (Parker, Waterman, Wahl-Eversharp, Sheaffer, Montblanc, Pelikan, Pilot/Namiki, Omas, Conway Stewart, special & limited editions…); product pages (which carry a JSON-LD Product with the same data), /search.php, cart/account/checkout and the '_bc_fsnf' faceted URLs disallowed by robots.txt are never fetched. robots.txt (User-agent: *) allows category paths; named AI crawlers (GPTBot, ClaudeBot…) are disallowed but RareIndexBot is not, and the site answered 200 to the honest UA. Store policies describe grading (the '(Near Mint, Restored)' suffix) and contain no automated-access clause. Dealer asking prices only → listings; accessories/consumables (ink, converters, refills, parts, nibs) are filtered out; the '(1950s)' era is kept as metadata, exact years as `year`. 3 s between requests, one connection, 4 categories × 2 pages per daily run with seed rotation.",29  "enabled": true,30  "schemaVersion": "1.0",31  "config": {32    "pagesPerSeed": 2,33    "seedsPerRun": 4,34    "seeds": [35      { "path": "/pens-by-brand/parker/", "brand": "Parker" },36      { "path": "/pens-by-brand/waterman/", "brand": "Waterman" },37      { "path": "/pens-by-brand/wahl/", "brand": "Wahl-Eversharp" },38      { "path": "/balance-non-white-dot/", "brand": "Sheaffer" },39      { "path": "/pen-makers-usa/sheaffer/balance-white-dot/", "brand": "Sheaffer" },40      { "path": "/pen-makers-usa/sheaffer/snorkels/", "brand": "Sheaffer" },41      { "path": "/imperials/", "brand": "Sheaffer" },42      { "path": "/pen-makers-europe/montblanc/", "brand": "Montblanc" },43      { "path": "/pen-makers-europe/pelikan/", "brand": "Pelikan" },44      { "path": "/pen-makers-europe/omas/", "brand": "Omas" },45      { "path": "/pen-makers-europe/conway-stewart/", "brand": "Conway Stewart" },46      { "path": "/pen-makers-asia/pilot/namiki/", "brand": "Pilot Namiki" },47      { "path": "/pen-makers-asia/platinum-nakaya/", "brand": "Platinum" },48      { "path": "/pen-makers-usa/conklin/", "brand": "Conklin" },49      { "path": "/pen-makers-usa/esterbrook/", "brand": "Esterbrook" },50      { "path": "/special-and-limited-editions/" }51    ]52  }53}54
Files · 8fd03303eebf7df7e6b85f13b512e86dd3eab467
Menu

Theme