What if there could be a robot.txt kind of setting that users could use to preve... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		kovek on Oct 13, 2019 \| parent \| context \| favorite \| on: LinkedIn loses appeal over access to user profiles What if there could be a robot.txt kind of setting that users could use to prevent being scraped?

jakeogh on Oct 13, 2019 [–]

Pointless unless you want a one world governement to enforce a law monoculture.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact