Checkout youtube.com/robots.txt ! | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

techaddict009 on Feb 23, 2014 | parent | context | favorite | on: Google's robots.txt

Checkout youtube.com/robots.txt !

dabit on Feb 23, 2014 [–]

For the lazy: http://www.youtube.com/robots.txt

Mindless2112 on Feb 23, 2014 | [–]

And for those who don't know the reference: http://www.youtube.com/watch?v=WGoi1MSGu64

Consider applying for YC's Winter 2027 batch! Applications are open till November 2.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact