Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Scraping content isn't bad if you aren't redistributing it, technically your web browser is scraping content in the same sense.

http://paulgraham.com/robots.txt doesn't disallow robots from reading the essays.



Let's not be naïve. This is geek-clad redistribution.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: