SPB Git forge

spb/rareindex

Public
54commits 1branches 0releases
7.1 MBsize
maindefault branch
10 days agolast push
TypeScript 61.9% HTML 37.2% SQL 0.7%
2.5 KB · 42 lines json
Raw Blame History
1{2  "id": "pamono",3  "displayName": "Pamono (vintage design listings, USD storefront)",4  "sourceId": "pamono",5  "sourceName": "Pamono",6  "sourceType": "marketplace",7  "sourceUrl": "https://www.pamono.com",8  "module": "api/pamono",9  "enginePriority": ["api"],10  "categories": ["design_furniture", "antiques", "porcelain", "glass_crystal", "silver", "clocks", "jewelry", "other_watches", "art"],11  "regions": ["DE", "US", "EU"],12  "languages": ["en"],13  "currency": ["USD"],14  "supportsListings": true,15  "supportsSold": false,16  "supportsAuctions": false,17  "supportsImages": true,18  "supportsCatalog": false,19  "supportsPopulation": false,20  "supportsLookup": false,21  "refreshFrequencyMinutes": 1440,22  "priority": "low",23  "trustScore": 0.7,24  "attributionRequired": true,25  "termsUrl": "https://www.pamono.com/terms",26  "acquisitionMethod": "public HTML (Magento category grid, itemprop price)",27  "historicalDepth": "none",28  "accessNotes": "Pamono (Berlin; the pamono.com store prices in USD, the .eu/.de/.co.uk stores in EUR/GBP) renders its category grids server-side: /furniture, /lighting, /home-accessories and /jewelry-watches (?p=N, about 100 <article class=\"product-card\" data-sku> cards per page) expose the product link, title, price (itemprop=price content=…, optional old-price on sale items) and the cdn20.pamono.com image. We read only those category pages; the product pages, /catalog/ (disallowed), /catalogsearch/, wishlist/customer/checkout paths and the /terms/ page (also disallowed for crawlers, hence not reviewed automatically) are never fetched. robots.txt (User-agent: *) allows the category paths; other bots are given Crawl-Delay 5–7 s, so we wait 4 s between requests with a single connection. No anti-bot challenge for the honest bot UA. Asking prices only → listings; the store currency is read from the inline `add.state.currencyCode` bootstrap and cross-checked with the price symbol. Designer/maker is parsed from the title ('… by Maison Jansen', '… from Greaves & Thomas') and decades ('1970s') are kept as metadata rather than a year. Magento repeats the last page for out-of-range ?p= values, which the crawler detects to stop pagination.",29  "enabled": true,30  "schemaVersion": "1.0",31  "config": {32    "pagesPerSeed": 2,33    "seedsPerRun": 2,34    "seeds": [35      { "path": "/furniture", "vertical": "furniture" },36      { "path": "/lighting", "vertical": "lighting" },37      { "path": "/home-accessories", "vertical": "decor" },38      { "path": "/jewelry-watches", "vertical": "jewelry" }39    ]40  }41}42