Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

is your extractor open source? (if so, could I get a link?)


This:

https://github.com/scrapinghub/extruct

does ld+json, microformats, microdata, rdf3a, and opengraph mostly by calling other packages.


thank you so much for the link.

I feel if we could give users/devs/whoever an appreciation for the structured data (or lack thereof) in a page and it's benefits we might see a general improvement in usability and interoperability. One can dream.


Yeah, one thing I would like to create in my web-scale crawling activities is some structured data discovery tools. Google surfaces a few things as part of their search results, but not in bulk.

This project http://webdatacommons.org/ extracts from Common Crawl, but it's just raw data and you're on your own for visualization and discovery tools!


Thanks again - it was very easy to install and use.

I think something like this: https://www.ssllabs.com/ssltest/

but for embedded data would be interesting.




Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: