I've almost entirely replaced Pandas with DuckDB in my day-to-day work. I wonder if it would be an easier lift for someone who is familiar with SQL, and doesnt want to pick up Pandas/Polars.
This comment might finally push me to try DuckDB, thanks. I’m quite proficient with scientific python in general, but Pandas API is just alien (and slow). SQL is more natural for its domain.
It's designed for analytics work. Some examples:
* You could run a bunch of analytics queries directly on a jsonlines, csv, or parquet file (or even glob of files).
* You can output directly to a pandas or polars dataframe
* You can use numeric python functions inside of queries
* You can also attach to S3 buckets, postgres databases, or sqlite databases and query them directly.
