Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Any particular libraries or techniques you used for the crawling / parsing, or just coded up something from scratch for each site you crawl? (I think I noticed you even do kijiji.)


All of it is from scratch. Yep, I do Kijiji, but only in Canada, because I was told it's more important than CL in some parts there.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: