Projects
experimentsdata
Inbox to SQLite in under a weekend
Notes on the pipeline that syncs email digests into a local SQLite file for dashboards.
Shipping the inbox → SQLite pipeline forced me to keep every decision honest. I wanted summaries ready by Monday morning without adding another SaaS. The constraints were simple:
- ingest the best bits from a handful of newsletters
- normalize them into a tidy table
- keep the stack portable so future me can run it on a train with flaky Wi-Fi
I ended up with one script that watches a label:weekly-digest mailbox, stores the parsed JSON into SQLite, and triggers a tiny Observable notebook. The “aha” moment was noticing how much calmer review sessions felt once the dashboards opened instantly offline.
The next iteration is adding temporal diffing so I can answer “what changed since last standup?” without scanning raw emails.