SPB Git

spb/wp2_uqo Public

UQO Working Paper No. 2 — Decoding Real Estate Descriptions: text-based hedonic analysis of housing listings.

TeX 73.8% Python 26%
7.1 KB · 114 lines markdown
Rendered Raw Blame History
1<!-- Author: Simon-Pierre Boucher — contact@spboucher.ai -->23# PAPER_REVIEW — critical assessment before the scholarly upgrade45Paper: *Decoding Real Estate Descriptions* (UQO WP No. 2), 47 pp., 59 references.6Assessment date: 2026-08-05. Basis: full read of `paper/` + the pipeline in7`src/``scripts/` and the verified results in `results/`.89## 1. Core contribution — is it clearly stated?1011**Yes, and it is real**: projecting sentence embeddings onto researcher-defined12reference descriptions ("concept projection") to obtain *named, signed,13interpretable* text features for hedonic inference, with an honest14quantification of the interpretability-vs-fit trade-off against PCA. The15three-part contribution statement in the introduction is crisp.1617**But it is under-positioned.** The paper frames itself only against the18"text in real estate" niche. It never connects to:1920- the **text-as-data program in economics** (Gentzkow–Kelly–Taddy; Ash–Hansen;21  Hansen–McMahon–Prat), where the method is naturally described as a22  *continuous, embedding-based generalization of dictionary methods* — a framing23  that both strengthens novelty and inherits a mature methodological literature;24- the **structural hedonic identification literature** (Ekeland–Heckman–Nesheim,25  Bajari–Benkard, Kuminoff–Smith–Timmins), which is the right anchor for the26  paper's careful "conditional association, not causal" stance;27- the parallel literature on **unstructured data for housing quality** other28  than text — notably computer vision on listing photos (Glaeser et al.;29  Poursaeed et al.) — which makes the case that text is one member of a family30  of quality-revealing unstructured signals.3132## 2. Literature review — gaps3334Current coverage is good on: hedonic surveys (Sirmans ×2, Malpezzi), functional35form (Halvorsen–Palmquist, Cropper), text-in-real-estate (Nowak–Smith, Shen,36Hong, Lam, Demers, Goodwin, Huang), sentence embeddings (SBERT, MiniLM, SimCSE,37BERT, anisotropy), and scattered econometrics (Koenker, Breusch–Pagan, HC3,38Lasso/ENet, O'Brien).3940**Missing subfields (each currently has zero citations):**4142| Strand | Why it matters here | Candidate anchors |43|---|---|---|44| Text-as-data in economics | The paper's method is an instance of this program; dictionary methods are its direct ancestor | Gentzkow–Kelly–Taddy (2019 JEL); Ash–Hansen (2023 ARE); Hansen–McMahon–Prat (2018 QJE); Loughran–McDonald (2016 survey) |45| Hedonic origins & identification | "Implicit prices ≠ willingness to pay" needs its canonical sources; origins misattributed to Lancaster–Rosen alone | Court (1939)/Griliches (1971); Ekeland–Heckman–Nesheim (2004); Bajari–Benkard (2005); Kuminoff–Smith–Timmins (2013) |46| Quantile hedonics | §Robustness runs quantile regressions with no housing-quantile citation | Zietz–Zietz–Sirmans (2008); McMillen (2008) |47| Listing-language & agent remarks | The *closest competing literature* — absent entirely | Pryce–Oates (2008); Haag–Rutherford–Thomson (2000); Levitt–Syverson already cited but under-used |48| Spatial hedonics | §Limitations discusses spatial controls citing only the LeSage–Pace textbook | Dubin (1988); Can (1992); Anselin (1988) |49| Quebec/Canada housing | A Quebec paper with zero Quebec housing references | Des Rosiers et al.; Dubé–Legros (spatial hedonics, Québec data) |50| Computer vision on listings | Sibling "unstructured data" literature | Glaeser–Kincaid–Naik (2018); Poursaeed et al. (2018) |51| Interpretable ML | The paper's core value proposition, currently anchored only by concept bottlenecks | Rudin (2019); Lundberg–Lee (2017) |52| Disclosure theory | Milgrom (1981) cited alone; the standard pairing is with Grossman (1981) | Grossman (1981) |53| ML econometrics practice | One-sided (Athey; Mullainathan–Spiess) | Varian (2014); Dell (2025, deep learning for economists) |5455## 3. Weak argumentation / unsupported claims56571. "Realtor.ca + Centris capture the near-universe of listed properties" — no58   citation; keep but soften or attribute to platform documentation. **Flagged.**592. "all-MiniLM-L6-v2 … Spearman 0.82 on STS-B … ~5× faster than BERT-base" —60   from the model card, uncited. Add the sentence-transformers/model-card source61   or soften. **Flagged.**623. Conneau et al. "up to 15% monolingual performance loss" — check against the63   actual paper's numbers; keep only if defensible. **Flagged.**644. Urgency discount (−8.5%) is discussed with Levitt–Syverson but never65   quantitatively compared (their agent-owned premium ≈ 3.7%); an explicit66   magnitude comparison would sharpen the discussion.675. Quantile findings are not compared to the housing-quantile literature68   (Zietz et al. find larger implicit prices at upper quantiles for many69   attributes — our Luxury gradient agrees; that agreement is currently unstated).706. The negative Family-Friendly/New Construction coefficients are interpreted71   as locational sorting — plausible, but the argument would benefit from the72   sorting/access-to-amenities literature anchor (Kuminoff et al.).7374## 4. Underdeveloped sections7576- **Introduction**: solid but thin on stakes (AVM/mass-appraisal economic77  importance; text-as-data momentum). No explicit "this paper speaks to three78  literatures" paragraph. Roadmap present.79- **Related work**: organized by method type, which is good, but missing the80  four strands above; the "research gap" subsection can be sharpened into a81  two-sided gap (economics side and NLP side).82- **Methodology**: several choices lack citations — semi-log form is cited, but83  standardization-for-comparability, the dictionary-method lineage of the84  reference design, and the zero-shot/anchor analogy are not.85- **Discussion**: interprets results internally but rarely *against* prior86  findings (no numeric comparisons to Nowak–Smith's keyword premiums,87  Levitt–Syverson's magnitudes, Zietz et al.'s quantile patterns). Limitations88  are strong (post-restructuring) — keep.89- **Conclusion**: fine; can absorb one paragraph tying back to text-as-data.9091## 5. Positioning: current vs. target9293**Current**: "an NLP paper for real estate economists" — a niche methods paper94competing with Lam et al./Shen on prediction.9596**Target**: an **applied-econometrics paper in the text-as-data tradition**:97interpretable feature construction from unstructured data for classical98inference, demonstrated on housing. That positioning (i) inherits the99Gentzkow–Kelly–Taddy legitimacy, (ii) makes PCA/embedding opacity the natural100foil, (iii) frames the reference descriptions as a *continuous dictionary*,101and (iv) generalizes the contribution beyond real estate (as the conclusion102already gestures).103104## 6. Upgrade plan (targets)105106- References: 59 → **~85–90**, all new entries verified via OpenAlex (DOI when107  available).108- Length: 47 pp → **~54–56 pp** (+15–20%): intro +~1 p, related work +~2.5 pp109  (two new subsections + restructuring), methodology +~0.5 p (grounding110  citations), discussion +~2 pp (literature-facing interpretation + magnitude111  comparisons), conclusion +~0.3 p.112- Untouched: all results, tables, figures, robustness numbers, data section113  statistics.114