Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

R’s data.table package is faster at these things out of the box than any single instance of a database server I’ve encountered. This is frustrating because I’m trying to explain some systemic issues we suffer by not using a relational database, but it’s really hard to make my case when data.table is one install.packages away and a version upgrade from Postgres 9 to something a little faster is gatekept by bureaucracy. I’ve been trying for months!


You need a columnar database for good performance. Try DuckDB to ease them into it, it's a columnar SQLite.


Thanks, I’m checking it out, it seems pretty interesting to keep an eye on. Lots of properties that would be useful in our shared computing environment like not requiring root or Docker.


Might also be worth running a local instance of Postgres 13. Super easy to do on Windows without administrator rights.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: