I've been looking at dbt for exactly this reason but don't quite get the advanta... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		geysersam 13 days ago \| parent \| context \| favorite \| on: Pre-Release of Polars 2.0 I've been looking at dbt for exactly this reason but don't quite get the advantages if you're not interacting with a data warehouse of some sort.
		help

OoooooooO 11 days ago | [–]

Spark/PySpark/polars/dbt/sqlmesh are all data engineering frameworks for data transformation (and some data scientists).

If you don't have a data warehouse / OLAP system you are generally not in the niche for those tools.

vovavili 13 days ago | [–]

Embedded databases like DuckDB are just as suited for dbt work.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact