Most sites don't have their main data/functionality in the Disallow section thou... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		aledalgrande on Sept 10, 2019 \| parent \| context \| favorite \| on: 9th Circuit holds that scraping a public website d... Most sites don't have their main data/functionality in the Disallow section though.

dodobirdlord on Sept 10, 2019 [–]

Sure, but they could if they wanted to and that's their own business.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact