Real Estate Study Exposes Zillow and Trulia As MLS Lacking: A Call for Local Coverage Disclosure


Real estate is local. And consumers want to see all the local listings, especially the MLS listings the real estate agents get to see. So why don’t national real estate sites publish their local MLS coverage percentage on the website? Ahh…. maybe because their MLS coverage is pitiful. If you have crummy coverage, tell Joe Homebuyer. He may decide not to waste his time there. If you have great coverage, give him the assurance he’s come to the right place to search. Just tell him the local coverage stats and stop hiding behind your gross number of listings!

Let’s start with Trulia and Zillow. Tell local home searching buyers whether they are seeing the whole MLS listings pie or only a sliver. You got the tech heads to do it, if you don’t already know– so let’s see what you really have LOCALLY. It’s about time you guys stopped hiding behind your “3 million listings” perception marketing pitch. It’s time you told the public the true extent of your local listings coverage. We all know you don’t have 100% of the listings in EVERY market and probably not in most– so let’s get transparent, shall we, and give the consumer the local truth—publish the local listings coverage percentage when John Q. Public does a search in a city so he doesn’t waste his time putzing around your heat maps and zestimate stock graphs.

This little rant was brought on by an interesting post at TechCrunch comparing the comprehensiveness of national real estate websites Zillow and Trulia vs. regional/city MLS-based sites like Roost and Redfin. Turns out the big marquee names don’t cover listings as well in all markets (pros know it, but certainly most consumers don’t).

As Techcrunch writer Eric Schonfeld points out, “If the MLS in any given city is the benchmark, both [Zillow and Trulia] have a lot of work to do.”

While TruZillia will boast, “We got 3 million+ listings”, the fact of the matter is a guy in Kalamazoo could give 2 hoots and a holla: “What ‘ya got in Kalamazoo?” And if the answer is less than ALL THE LISTINGS– or at least all the MLS listings the broker you may hire will see, I’d say the site is of limited value to him. At least if consumers knew the truth, they could decide.

In knocking the study stats, Trulia’s VP of Marketing, Heather Fernandez, seemed to take some pride in having 70% coverage in most metro areas …. whatever that means. But isn’t the buying public entitled to know if you’re missing a third of the listings in their city (not metro “area”)? Will you tell them? (I didn’t think so)

Interestingly, Roost jumped into the fray by saying “Hey, look at us, we got the golden MLS goose giving us 100% coverage while those big saps can’t even muster 65% ” The Rooster cited a WAV Group study which examined MLS listing coverage in Miami, Dallas & San Diego and showed that Roost had better MLS coverage than TruZillia. Duh.

The results are ….. not surprisingly, Roost comes out looking great. For each city, it returns between 95 and 99 percent of the listings in the MLS. Trulia’s accuracy in the study ranges between a pitiful 9 percent for San Diego to 61 percent for Miami. (Zillow generally does worse across the board, with its accuracy ranging between 12 percent and 36 percent across the three cities) [TechCrunch]

While this is most probably true, Roost seemed to have laid a goose egg with the skewed comparison numbers and WAV Group’s limited methodology (3 bed, 2 baths homes within a $50,000 range) — you gotta watch those slippery statisticians. And some commenter was quick to point out the fact that good ‘ol WAV Group’s customers include, you guessed it, MLS. When you spin it, make sure you’ve got a good spinner.

But while TruZillia has been de-pantsed, let’s not forget that while the MLS may be (is) the most comprehensive database of listings (guestimate 80%), the remainder are FSBOs and foreclosures. Real estate search nirvana is still a dream.

Additional rant: Let’s stop calling real estate listing sites (read Trulia) search engines. It’s misleading. They have a search engine to search their stuff but they are not search engines in the consumer understood Google sense that they search everyone’s stuff. During the Blog Tour we asked an open house visitor how they found the home. They said they used a Chicago search engine we never heard of. We looked it up and it was a broker site calling itself a “search engine.” There should be a depantsing when your pants are on fire.

Read the Techcrunch post and don’t neglect the comments. In one, Trulia claims to have the best NYC coverage. Sebastian of New York’s own Streeteasy, calls them on it. (personal bias here: I’d say Streeteasy kicks Tru butt in NYC. Sorry Heather.) Kevin Boer displays his usual panache.  Oh yeah, this gem from David G of Zillow on Roost: “The first sentence on Roost’s website says “Every home for sale …” Clearly that is a lie and this study is an ill-conceived and biased attempt at creating BUZZ around Roost’s false claims.”  followed by this friendly sales pitch: “Please get hold of me regarding publishing Zillow’s FSBO inventory on ROOST.” Real estate makes for some strange bedfellows.

Technorati Tags: , , , , , , ,

Share This Post
  • Hello Joe.

    Great post as always, few comments.

    A) "Real estate search nirvana is still a dream." - which is why most buyers search multiple sites and why we are trying to make it easier and faster for them to do what we already know they are doing.

    B) "they are not search engines in the consumer understood Google sense that they search everyone’s stuff" - Couldn't agree with your more. I think only dothomes and us are true search engines.

    C) One comment that surprised me was Marty Frames' from Cyberhomes who said the FSBO argument is "red herring", I respect Marty alot but thought this was way off base. I do think that cyberhomes maybe in the best position for coverage due to their access to data and ownership in some MLS's via FNRES, so will be interesting how they evolve.
  • If there is anyone who understands real estate search, it's you Jessie. I admire Retrove's mission to achieve the real estate nirvana buyers want-- to see it all. And there is no doubt Retrove IS a SEARCH ENGINE.

    But it even goes beyond comprehensiveness of local listings. Real estate search is "fuzzy" search. Do a search for ocean view homes in Riverside, CA on Realtor.com and you get a few thousand results. The only problem is --there are NO oceanview homes in Riverside (unless you own a Hubble telescope).

    If a buyer gave you a laundry list of "must have" features-- good luck with that. It's a needle in a haystack search and having thousands of listings to sift through is no solution. Roost is on the right track with their filtering system.
  • Totally agree with the filtering and your "fuzzy" search. The issue is always "GIGO". For most of the others RE.net sites they are access data via feeds and that data does not contain the details your are mentioning. Roost solution of having the feeds directly from the MLS does give them the ability to apply those types filters assuming the MLS provides access to the fields but then again a broker could provide the same functionality to their own buyers also with their own IDX powered solutions.
  • You're right. The key to search is list. I would venture a guess that
    consumers would settle for less than all the listings if 100% search
    accuracy were there. But no one is working on it because they think it is a
    numbers game. The gross listings numbers game is solely a marketing pitch.
  • DrewIzzo
    Good stuff Joe. Thanks for your perspective. Drew
  • Joe -

    You fail to report that the Techcrunch author decided that the methodology behind the ROOST study is bogus. Let’s get local. Here's San Diego …

    - In Q2, 31% of the homes sold in San Diego were foreclosures yet this study ignores foreclosure listings. Could that be because there aren't many REO properties in the ROOST / MLS inventory?
    - The average home value is $420K yet this study cherry-picked 3-bed 2-ba homes in a $50K range under $350K. Let’s face it, the sample used in this study is hardly representative of the real estate market and clearly contrived to produce this outcome.
    - ROOST currently lists 6118 listings in San Diego.
    - Zillow currently lists 7661 for sale listings in San Diego. 104 of those are FSBO but many more are Foreclosures; neither of which are on Roost's site.
    - Zillow also lists 732 Make Me Move listings in San Diego. Those listings can not be found on any of the sites mentioned in this post.

    The first sentence on Roost’s website says “Every home for sale …” Clearly that is a lie and this study is an ill-conceived and biased attempt at creating BUZZ around Roost’s false claims.
  • I reported that *I* thought the methodology was suspect:

    *While this is most probably true, Roost seemed to have laid a goose egg
    with the skewed comparison numbers and WAV Group's limited methodology (3
    bed, 2 baths homes within a $50,000 range) — you gotta watch those slippery
    statisticians*.

    But you must agree the post raises a valid point: Local MLS coverage is
    important and consumers have no idea what each site brings to the table. I
    think home searchers should know this local coverage stat--* don't you?

    *To tout 3 million national listings is a bit misleading IMO and detracts
    from the real consumer need-- local coverage. Transparency would demand
    that you tell consumers that %, no? *Will Zillow pick up the challenge and
    publish their local coverage stats? It would be a feather in your big cap.*

    P.S. Interesting that you called Roost on a "lie" but did not report on
    Trulia's search engine claim. If Trulia is a search engine, so is Zillow, so
    is this blog. Perhaps you consider Roost more of a long term threat. I
    think they are-- especially if they can find themselves a David G :)
  • Just FYI, from Redfin: we publish a fairly direct list of what inventory we have and what we don't:
    http://www.redfin.com/help/search/the-most-home...
  • Certainly of value to the consumer, Glenn. But will others follow suit?
    Doubtful.
  • Interesting take Joe.
    HomeGain gets criticized for not having a lot of content on our site-that's because we send listing searchers from Homegain.com directly to agent web sites who have the right to display listings via IDX.

    We have thousands of such agents as HomeGain members in our Buyerlink program doing so.
  • [quote=Louis] HomeGain gets criticized... we send listing searchers from Homegain.com directly to agent web sites who have the right to display listings via IDX.[/quote]

    The logical question I have here what real service do you offer the consumer???

    If that consumer knew the truth about the MLS coverage you have (or more accurately the lack of) would they use Homegain to begin with?

    I don't think so!

    Dennis Pease
    Eugene OR Real Estate
  • Dennis would you prefer that the consumer use Google to find the agents' web site?
    What service does Google provide?
  • Bob
    @Louis - Yes.
  • Sorry, Google is not the right answer. I LOVE Google, but use the right tool for the job. If all you have is a hammer, then everything looks like a nail. (Mind you, Google is no hammer - perhaps more of a swiss army knife.)

    Who has the most listings in an area? This sounds like the old discussion of whether we should be using Google or Yahoo or AltaVista as the "best" search engine based on how many documents and web pages they have indexed. The real question is what "search engine" is best for the kind of information they are best at finding for your needs. Are you looking for social information? Are you looking for technical documentation? And in that context, it is ok to call these tools "search engines", providing you understand that they are limited to "real estate".

    You need tools that are appropriate for the context - something that understands the significance of 3 bedrooms, 2 baths, 1250 sq ft.

    Yes, it is a fledgling "industry" to provide national (worldwide) listings. It will get better with time and effort.
  • Thank you for your thoughtful comment Robert.

    Since RE brokers and agents' are generally required to put their listings in
    their local MLS, it is the repository containing the most listings in a
    local area and should be the right tool for real estate search. And since
    it best understands the context of beds and baths, it ought to be the go-to
    source-- or at least 1 of them. Thus, I think 3rd party real estate sites
    will be forced, hopefully, to disclose what % of local MLS coverage they
    have. Consumers will then know whether it is better for them to stop in
    their local brokers office and get a gander at the good stuff.
blog comments powered by Disqus

Blog Widget by LinkWithin