# data/ — not tracked by git This directory is excluded from version control because: 1. `raw/louka.db` (268 MB) exceeds GitHub's 100 MB per-file limit; 2. the database contains a leftover application `users` table (credentials) that must not be published; 3. the listing texts are proprietary platform content (Realtor.ca / Centris). ## Restoring the data locally Place the SQLite database at: ``` data/raw/louka.db # table `properties`: 46,479 listings, 5 categories ``` (or set the environment variable `WP2_DB_PATH` to its location), then run the pipeline from the repository root: ```bash python3 scripts/01_prepare_data.py python3 scripts/02_similarities.py python3 scripts/03_models.py python3 scripts/04_robustness.py python3 scripts/05_figures.py python3 scripts/06_tables.py python3 scripts/07_revision_extensions.py # 2026-10-17 revision: language, FE, OOS, sensitivity, multilingual encoder python3 scripts/08_revision_tables.py ``` The pipeline recreates everything under `data/processed/`: | File | Content | |---|---| | `houses.parquet` | analysis sample (17,087 × 14, incl. remarks text) | | `embeddings_maisons.npy` | 17,087 × 384 sentence embeddings (cache) | | `sim_matrix_maisons.npy` | 17,087 × 20 cosine-similarity matrix | | `hedonic_maison_results.csv` | analysis dataset used by all models/figures | | `embeddings_multilingual.npy` | 17,087 × 384 embeddings from paraphrase-multilingual-MiniLM-L12-v2 (cache, step 07) | | `revision_fields.csv` | language class, FSA, municipality, lot and floor area (m²) per listing (step 07) | | `legacy/` | pre-refactor artifacts kept for byte-level comparison | Embeddings are deterministic for a given model version, so a fresh run reproduces the committed results exactly (see `docs/CHANGES.md` §3 and `docs/CHANGELOG-REVISION.md` §1). Both sentence-transformers models are downloaded from the Hugging Face hub on first use (about 90 MB and 470 MB).