Hacker Newsnew | past | comments | ask | show | jobs | submit | evc's commentslogin

Parler is rolling, zuck's friends hating


You will need a lot of disk storage right?


There are different extractors/services, and you can toggle them pretty easily. By default it screenshots everything, exports a PDF, saves like 4 different HTML copies and submits the link to the wayback machine. It also tries to extract important text, and stores that separately. You could easily configure it to only extract text, turn off some HTML extractors, or disable the PDF and screenshot captures if you want to prioritize disk space.


it doesn't show in the Screenshot in the article, but ArchiveBox in Aug 2020 implemented the "readability article text extractor", see description in the release notes: https://github.com/pirate/ArchiveBox/releases/tag/v0.4.14 and the module that does the work https://github.com/pirate/readability-extractor

By only extracting text and article images you could go deep into an archive. If you skip images, much more so


That probably depends on the scope of what you're looking to archive. If you're looking to make up local backup of your bookmarks folder (as one of the intentions seems to be), probably not an unreasonable amount of storage. Maybe a few GB at most(if you have a moderate to large bookmarks folder), depending on how many sites/heavy the sites are?


For reference, archivebox uses 250GB for 5000 links in my setup.


That is an insane amount of storage for so few links. Is your setup somehow very greedy?

Saving article only view (images + text) should probably do better

I suspect your numbers come from JavaScript and css, etc? Is there a way for archivebox to not download react 5000 times but share source files? Most likely custom bundles that sites compile will not make this possible most of the time. Just thinking out loud here.


It's recommended to run it on a compressed filesystem like ZFS. On mine it's using ~75GB for ~3000 URLs. It varies greatly depending on the content, usually the vast majority of storage is from video/audio ripped with youtube-dl.


Who does even read newsletters nowadays?


Location: Almaty, Kazakhstan

Remote: Yes

Willing to relocate: Yes

Technologies: React, React-Native, NodeJS, GraphQL, MongoDB

Résumé/CV: http://stackoverflow.com/cv/medet

Email: [email protected]

Github: https://github.com/vko-online

Stackoverflow: https://stackoverflow.com/users/2308005/medet-tleukabiluly


What is this all about?


Having all resources that an application needs in the GPU memory, I think.


Not quite.

Having everything the app needs available to the GPU at all times without having to explicitly load them from disk to graphics memory beforehand in userland code (and cycled out as needed) - having it happen automatically so less code needs to be written & debugged in the app/framework, and having it happen in the kernel so it is potentially more efficient (allowing for more complex scenes and/or more detail and/or faster frames, on the same hardware).


so why do we need that? there are a lot of origami examples, but this one from google, and you all start to bustle.


I'm too lazy^H^H^H^Hbusy and I don't want to be sourcing the lenses, NFC tag, etc. This is great for me.


This idea maybe born when E.Snowden revealed some secrets, as you know USA spectates everyone everywhere


Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: