raven sync-jobs #
Download openjobdata daily deltas into a local SQLite index.
Usage #
raven sync-jobs
raven sync-jobs --days 3
What it does #
- Syncs companies registry from HuggingFace bucket
- Downloads recent daily parquet deltas
- Upserts into
data/jobs.db - Exports ATS company slug lists to
data/cache/ats-companies/
Environment #
If you get HTTP 401:
# .env
HF_TOKEN=hf_xxxxxxxx
After sync #
raven discover --sources index --q "engineer"
raven query --q "ML engineer" --since 7
Flags #
| Flag | Description |
|---|---|
--days N | Number of daily deltas to fetch |
--full | Full backfill (slow) |
--no-export-ats | Skip ATS slug export |
See openjobdata for details.