Not something available to smaller sites | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		rcxdude 9 months ago \| parent \| context \| favorite \| on: Devs say AI crawlers dominate traffic, forcing blo... Not something available to smaller sites

charcircuit 9 months ago [–]

Yes, it is. They transitively get it via the agreements the smaller site's host's host makes. Or via services like Cloudflare.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact