SPB Git forge
38commits 1branches 0releases
338.7 MBsize
maindefault branch
3 h agolast push
HTML 53.9% TypeScript 44.5% JavaScript 0.6% SQL 0.5%
2.2 KB · 43 lines yaml
Raw Blame History
1# PJM Interconnection — news releases (PDF) + Inside Lines — connector definition (see docs/connectors/pjm.md)2id: pjm3name: "PJM Interconnection — news releases & Inside Lines"4domain: www.pjm.com5kind: utility6mode: hybrid7priority: 28license: "Corporate press releases and newsroom articles (PJM Interconnection, L.L.C.); facts and links only"9attribution: "PJM Interconnection (pjm.com, insidelines.pjm.com)"10homepage: https://www.pjm.com/about-pjm/newsroom11notes: "Largest US grid operator (13 states + DC, incl. Northern Virginia). News releases are PDF files linked from the announcements page (the www.pjm.com RSS endpoint returns an empty channel); Inside Lines is the WordPress newsroom with an RSS feed (robots.txt allows everything but /wp-admin/; served at L1 to the crawler UA, but a generic 'Mozilla/5.0 (compatible; …)' UA gets 403 from its WAF). Hot-weather / operations updates mention data centers in passing and are archived as events only."12coverage: { countries: ["US"] }13fetch:14  level: 115  maxLevel: 216  rpm: 1017  concurrency: 118  respectRobots: true19  maxCreditsPerRun: 020discovery:21  seeds:22    - { url: "/about-pjm/newsroom/announcements-and-news-releases", group: seed, pageType: news_index }23  rss:24    - "https://insidelines.pjm.com/feed/"25  follow: ["/-/media/DotCom/about-pjm/newsroom/\\d{4}-releases/[^/]+\\.pdf$"]26  include:27    - "/-/media/DotCom/about-pjm/newsroom/\\d{4}-releases/[^/]+\\.pdf$"28    - "^https://insidelines\\.pjm\\.com/[a-z0-9-]+/?$"29  exclude: ["insidelines\\.pjm\\.com/(category|tag|page|author|feed|wp-)"]30  classify:31    - { pattern: "/newsroom/\\d{4}-releases/[^/]+\\.pdf$", group: newsroom, pageType: press_release, priority: 70 }32    - { pattern: "^https://insidelines\\.pjm\\.com/[a-z0-9-]+/?$", group: newsroom, pageType: press_release, priority: 70 }33schedule:34  newsroom: daily35  rss: daily36  seed: daily37extractors:38  news:39    pageTypes: [press_release, project_announcement, expansion, acquisition, construction_update, planning_document, power_infrastructure, utility_announcement, closure, cloud_region, financial_disclosure, facility_page, operator_page, unknown]40    kind: news_event41    parser: news_press_release_v142    params: { keepText: true }43