CLAUDE.md — WP23: Next-Generation Real Estate Price Forecasting
Protocol as received on 2026-10-21 (the pasted text ended at section 17 "11. Prob"; sections 17–end were completed from the UQO working-paper conventions, see docs/PLAN.md). WP22 (
../sharp-hpi-quebec) is read-only for this project.
Research Program: WP23 — UQO Working Paper Series
Proposed title: Beyond Hedonic Models: Novel Spatiotemporal, Hierarchical and Probabilistic Architectures for Residential Real Estate Price Forecasting Alternative title: Forecasting Housing Markets with Transaction-Level Data: New Machine Learning Architectures, Spatial Dependence and Dynamic Market Signals Paper number: WP23 · Language: English · Output: complete academic LaTeX manuscript, reproducible Python research pipeline, original forecasting models, empirical results, tables, figures and supplementary material.
1. MISSION
Autonomous interdisciplinary research team (real estate economist, forecasting econometrician, ML architect, spatial econometrician, Bayesian statistician, time-series specialist, research engineer, scientific software developer, methodological referee). Develop WP23: do newly designed forecasting architectures substantially improve residential real estate price predictions? Same transaction database, geography and property characteristics as WP22. WP23 focuses on: (1) forecasting future property prices; (2) predicting local market movements; (3) genuinely novel forecasting methodologies; (4) testing whether spatial and temporal interactions improve forecasts; (5) combining property-level and market-level information; (6) calibrated probabilistic forecasts; (7) performance across cities, property types and regimes; (8) when complex models beat conventional ones. Prioritise originality, validity, performance, reproducibility. Never manufacture findings or claim novelty without verifying the literature.
2. DATA: REUSE THE WP22 INFRASTRUCTURE
2.1 Vrai Prix transactions, Quebec, 2021-01 → ~2026-10-07; prices, dates, geography, classes, characteristics, coordinates; WP22 engineered attributes. Inspect WP22 before developing; reuse extraction/cleaning/features/QC; never modify WP22. 2.2 Inspect availability of living area, lot area, age, bedrooms, bathrooms, floors, garage/parking, basement, condition, renovation, quality, type, coordinates, municipality, neighbourhood, date, price, assessment, listing-derived characteristics. Never assume a variable exists. 2.3 Engineered variables: spatial (density, distance to centres, spatially weighted neighbouring transactions, market clusters, similarity, price gradients); temporal (lagged local indices, lagged volumes, appreciation, rolling volatility, seasonality, liquidity, momentum); property (hedonic, interactions, type interactions, age transforms, quality-adjusted representations); market (municipal dynamics, regional dispersion, type trends, regime indicators, supply–demand proxies). Every feature computed from information available at the forecast origin; no leakage.
3. FORECASTING PROBLEM
Task A — future transaction price: P(i,t+h) = f(X(i,t), S(i,t), M(t), h); address transaction selection explicitly. Task B — quality-adjusted market price forecasting: WP22 indices where compatible with real-time forecasting; horizons 1, 3, 6, 12 months; targets = municipal, regional, type-specific indices, monthly growth, cumulative appreciation. Task C — probabilistic forecasting: predictive distributions (mean, median, intervals, quantiles, downside risk, P(decline), P(appreciation > thresholds)); distinguish estimation, transaction-noise, market-dynamics and macro uncertainty.
4. ORIGINAL ARCHITECTURES (≥ 5 candidates; literature search first; refine to a defensible contribution)
Model 1 HSHN — hierarchical spatiotemporal hedonic network: log P_it = fθ(X_it, Z_mt, G_m, h) + ε; hierarchical parameter sharing; compare full / partial / municipality-specific pooling. Model 2 DSGFN — dynamic spatial graph forecasting network: nodes = municipalities/submarkets; edges = proximity, co-movement, market similarity, composition similarity, spillovers; graph attention, temporal convolution, adaptive weights; test against SAR / spatial-lag forecasting. Model 3 RAREF — regime-adaptive forecasting: HMM, Bayesian regime switching, mixture of experts, gated architectures; regimes from information available at the origin only. Model 4 BHPF — Bayesian hierarchical probabilistic forecasting: hierarchical Bayes, hedonic information, dynamic local factors, spatial partial pooling, time-varying parameters; VI / Laplace / HMC on subsets; calibration, coverage, uncertainty decomposition. Model 5 QANSS — quality-adjusted neural state-space: price = quality + latent market + noise; neural hedonic representation + Kalman / nonlinear transitions + municipal latent factors; compare with the WP22 index forecasting framework.