Repository Public Research preview
1% Auto-generated by scripts/18_revision_language_leakage_spatial.py (2026-10-17)2\begin{table}[htbp]3 \centering4 \begin{threeparttable}5 \caption{Agreement Between Machine-Generated Attributes and Independent Sources}6 \label{tab:agreement}7 \footnotesize8 \setlength{\tabcolsep}{3.5pt}9 \begin{tabular}{@{}lccccccc@{}}10 \toprule11 Attribute & $N$ & Share (AI) & Share (ref.) & Agreement & $\kappa$ & Precision & Recall \\12 \midrule13 \multicolumn{8}{@{}l}{\textit{Panel A: LLM text layer vs.\ bilingual keyword rule on the same text}} \\[2pt]14 Garage & 19{,}123 & 40.8\% & 41.0\% & 98.2\% & 0.96 & 98.0\% & 97.6\% \\15 Swimming pool & 19{,}123 & 17.9\% & 23.9\% & 93.5\% & 0.81 & 98.8\% & 73.9\% \\16 Waterfront & 19{,}123 & 22.5\% & 9.2\% & 86.2\% & 0.50 & 39.8\% & 97.7\% \\17 Fireplace & 19{,}123 & 21.9\% & 23.6\% & 96.7\% & 0.91 & 96.3\% & 89.4\% \\18 Central A/C or heat pump & 19{,}123 & 11.5\% & 18.9\% & 90.8\% & 0.65 & 92.5\% & 56.0\% \\19 Finished basement & 19{,}123 & 35.5\% & 31.9\% & 80.5\% & 0.56 & 67.5\% & 75.0\% \\20 \addlinespace21 \multicolumn{8}{@{}l}{\textit{Panel B: Façade vision layer vs.\ text or structured fields (exterior shots only)}} \\[2pt]22 Garage visible vs.\ garage (LLM) & 18{,}314 & 47.5\% & 41.0\% & 67.6\% & 0.35 & 59.0\% & 68.4\% \\23 Garage visible vs.\ garage (keyword) & 18{,}314 & 47.5\% & 41.1\% & 67.4\% & 0.34 & 59.0\% & 68.1\% \\24 Waterfront setting vs.\ waterfront (keyword) & 18{,}314 & 6.5\% & 9.1\% & 91.1\% & 0.39 & 51.7\% & 37.2\% \\25 Row house vs.\ townhouse (listing type) & 18{,}314 & 12.7\% & 3.0\% & 89.0\% & 0.26 & 18.5\% & 79.0\% \\26 \bottomrule27 \end{tabular}28 \begin{tablenotes}[flushleft]29 \footnotesize30 \item \textit{Notes:} ``Share (AI)'' is the prevalence of the attribute according to the AI layer, ``Share (ref.)''31 according to the reference source; ``Agreement'' is the share of listings on which the two coincide, $\kappa$ is32 Cohen's kappa, and precision and recall treat the reference as ground truth (it is not: keyword rules miss33 negations and synonyms, and a garage need not be visible on the façade photograph). Visual storey count agrees34 exactly with the structured storey field for 60.5\% of 18{,}065 listings and within half a storey for 88.7\%.35 \end{tablenotes}36 \end{threeparttable}37\end{table}38