Please don't aggregate Foxtons. They are utter asshats and half their properties don't exist.

From my experience this is true of ALL rental agents.

Perhaps someone needs to get rid of them...

Our approach is collaboration filtering amongst house hunters + machine learning. Keep an eye on this ;).

yeah this kind of problem does happen in many property sources. At the moment the users can report "Expired ad" so those properties won't appear again. We are brainstorming hard to tackle this tricky problem.

Cool good stuff.

Couple of ideas you're welcome to (I played with exactly the same idea you have a few years ago but couldn't be bothered in the end):

The distinction between private and commercial ads isn't always clear, particularly on Gumtree where a lot of the time when you call a supposed private ad, it's actually an agent. You could add a "blacklist" of mobile telephone numbers which are known to be agents so if you view a private ad link there should be a link to "report this as a commercial property agent" and then after a threshold, mark any scraped ads with that number as commercial. Some people prefer going directly as the agency fees and service is utter crap and eats into your property budget pretty quick.

Add your own private adverts as well so you're the best augmented source of properties there are. Be the agent :-)

Also, don't just target the word "flat" - it can be a seen as a negative for non-flats so you're excluding some of your potential already. There is a lucrative market in high end housing which you could charge click-throughs on later to support yourself!

Enjoy :-)

The idea of marking mobile numbers is excellent, very useful!!!

Flat for rent/Flat for share is indeed just the category name, info of houses are included in the database too.

Rightmove's terms of use:

"You must not copy, transmit, modify, republish, store (in whole or in part), frame, pass-off or link to any material or information on or downloaded from this Site without our prior written consent."

Have you taken a licence from Rightmove et al for the data usage?

Did you get permission to republish that sentence before pasting it here?

Heh, nope, but it's an insubstantial part of the whole and thus wouldn't constitute infringement.

Plus my pasting of a company's terms to ask whether the OP is in compliance is hardly likely to attract the ire of the company, whereas if I was Rightmove's lawyers I might have an issue with someone taking parts of my database wholesale for usage on a competing site.

I personally think a competitor aggregating results is a positive thing, but I was just curious as to whether this was done with a licence or not.

we are taking them from a third party who is a partner with Rightmove which provides APIs for that.

Interesting, what is the name of this 3rd party?

Ah I see - thanks for the information. Nice looking site by the way.