SPB Git
502 B · 23 lines yaml
1# DuckDB and storage configuration2database:3  path: data/duckdb/edgar_research.duckdb4  memory_limit: "4GB"5  threads: 467parquet:8  base_dir: data/parquet9  compression: zstd10  compression_level: 311  row_group_size: 10000012  partition_by:13    filings: [form_type, fiscal_year]14    sections: [form_type, fiscal_year]15    chunks: [form_type, fiscal_year]16    embeddings: [model_name]1718storage:19  raw_dir: data/raw/sec20  processed_dir: data/processed21  metadata_dir: data/metadata22  logs_dir: data/logs23
Files · main
Menu

Theme