Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> Alexa seems like the worst.

Many of the bots disguise themselves as coming from Amazon or other big company.

Amazon has a page where you can check some details to see if it’s really their crawler or someone imitating it.



yup, actually most that I've seen are impersonating amazon




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: