Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

have you thought about writing your own API instead of using the de facto API? it may involve screen scraping but it also will be a lot more reliable and there's no limits, especially when using proxies....

I've written thousands of tools that scrape websites and never used the apis for this reason, you can never trust the API, either because of the reliability, cost, limits imposed, etc... Nobody wants you pulling data from their site anyway, so you're back to scraping anyway, its better to start out there then to have to end up there years later for some other reason...



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: