Why is HN opposed to scraping? I think since the front page is dynamically generated -- a bot would waste resources. The site gets loaded (slow to respond) during peak times.
Why would HN refuse to provide a useful RSS feed / a non standard compliant one (number of comments/points/time of submission/id) that could be used to develop apps for a better reading experience? http://api.ihackernews.com/ is unreliable at best.
because code written by N hackers scraping HN has a greater effect on the site, compared to using the reliable HNSearch API ~ http://www.hnsearch.com/api
Ask HN: Does HN have an API and if not what's the etiquette for scraping?
http://news.ycombinator.com/item?id=2138730
Ask HN: Is there an API for HN?
http://news.ycombinator.com/item?id=1107874
Beyond that, only pg could say...