Matt Cutts On The Hot Seat

About Matt Cutts

A personal interview of Google’s Matt Cutts from PubCon 2007 in Las Vegas. Instead of the usual shadow boxing — asking tricky SEO questions hoping Matt will slip up and offer some clues about the Google Secret Sauce — we decide to ask question he never hears and learn about Matt Cutts as a human being.

How does he feel about the annual NCAA conflict: Red State v. Blue State?

What it’s like to be the official taste tester for Ham versus Spam in the Google index?

Hanging with the enemy, does Spam become personal?

Wonder what life’s like after the Google IPO?

What motivates him to get out of bed every day?

Take 11 minutes and get personal with your favorite Google Spokes Model.

Republican Party For Sale At Yahoo

Wonder why Yahoo is having so much trouble monetizing their inventory?

I was reading a political blog when I noticed this Yahoo’s publisher network advertising the republican party of america at low prices on Yahoo store!

We all assume politician’s are corrupt and that votes are for sale, but this perhaps Yahoo has gone to far by suggesting RETAIL corruption!

Even more upsetting than the hilarious content was the ridiculous capitalization. The only words NOT capitalized in the sentence were the ones that should have been.

Republic Party for Sale at Yahoo

Google Gives Valentine’s Day Love to Spammers

Google, please stop giving Valentine’s Day love to parasitic marketers!

Here are some examples of people who are ranking their SPAM by posting it on crowd sourcing sites like NowPublic.com or free classifieds in Topix. Try a search for Valentine Lingerie and you will find the #4 position taken by A Splog Post on NowPublic.com and the #8 and #9 spots taken by two free classified listings from 2 different domains with essentially identical content on Topix.

It is really hard to make a coherent argument why these pages deserve to rank for Valentine Lingerie more than another costume & lingerie site. Topix and NowPublic have no incentive to fight this garbage unless the engines make them suffer for all of their content, because they get paid on the impressions.

For the “marketer” whose Splog post is on NowPublic, the 699 visits on the page to date might be worth the effort, but it definitely doesn’t mean they deserve the eye balls. NowPublic also doesn’t NoFollow links, even ones that seem to clearly be less than editorially controlled, so there may be (NOT) some PR flowing to the Spammer as well.

I am not sure if MSNBC and Foxnews deserve the love their getting from Valentine’s Lingerie more than NowPublic, but at least these articles aren’t spam, they are “news stories about fashion”.

Google, please stop ranking the SPAM. It encourages blackhats and causes blight in the index!

Parasitic Marketers dominate SERP

Search Spend Laps Display Advertising

Two studies tracking this race conclude that search marketing is lapping the alternatives.

Despite all the hype about display advertising and the block buster ad network deals of 2007, search continues to be the high performance engine that is driving online marketing spend. According to GroupM, search will make up 65-70% of the measured online advertising in 2008, up from 50% in 2005. For the mathematically challenged, that means search has gone from about even to 2 times the display spend. It also means most of the revenue growth has been from search. Nothing But Net, a new study by JPMorgan, meanwhile, puts the global search spend in 2008 at $30.5 billion.*

GroupM goes on to note that online advertising in Sweden is expected to exceed spending on any other channel, with the UK and Denmark likely to follow suit by 2009. Given that search is only getting about 10% of the dollars going to television in the U.S., we have a long way to go to catch up with our friends in Europe (and perhaps European companies need to wake up to the superior ROI of investing in SEO instead of relying on paid search)

Another interesting note from the study is that the 2008 U.S. election cycle is expected to contribute $2 Billion in local and national television advertising. No data is available at the moment, but it seems unlikely that search is getting 10% of that pie and it is clear at the moment that few of the campaigns are spending anything for SEO.

*We rarely call out a company’s SEO issues by name, but JPMorgan needs a lot of help. We wanted to link directly to the report, since we believe in citing source material whenever possible. Despite the fact that this study has been widely quoted, it is impossible to find any links to the study on JPMorgan.com. In fact, searching for study by name, JPMorgan + Nothing But Net, “JPMorgan “Nothing But Net” failed to find a press release, abstract or the study in the top 10. We went on to search for “site:jpmorgan.com nothing but net” and still couldn’t find the source.

JPMorgan Executives, if you’re listening, call us. 🙂

Kick Down Doors With Google Alerts

I used to spend more time than I care to think about getting through people whose job it was to make influential people people hard to reach. An amazing tool was introduced a few years ago that makes it easy to get around these roadblocks and get invited in the back door.

That amazing tool is Google Alerts, which allows each of us to get our own private alert whenever Google discovers a new page that contains a keyword or phrase we find of interest. It turns out that there is nothing I find more interesting than reading about me. It happens that many busy and accomplished people share this weakness.

Instead of beating your head against the corporate firewall, do a little social engineering. Post a blog (or even a blog comment) with someone’s name and people will read what you say about them. Does it work? Let me show you with a shout out to some of our friends. I won’t email/text/poke any of them, just to make this a valid demonstration.

Matt Cutts, Danny Sullivan, Kevin Ryan, Aaron Wall, Rand Fishkin, Gord Hotchkiss, Jeremy ShoeMoney, Doug Klein, Bill Gates and Stephen Colbert, let me start by saying hello.

I really appreciate you stopping by and I hope you are doing well. I know you are all really busy and I am really sorry that I called you under what you might consider false pretenses. Since you are here and you have responded to my honey trap…please take a minute and say hello to some of our other friends.

Thanks… and I guess I owe you a beer or something.

Google Reveals Adsense Click Fraud Rate is Above 20%

Forbes reported a couple of weeks ago about the latest skirmish over numbers between Google’s Shuman Ghosemajumder and Tom Cutler of Click Forensics. Reporter Andy Greenberg went right to the heart of the discussion by asking Google to address the July 2007 report by Click Forensics.

Within online content networks, Click Forensics estimated that more than 25% of all clicks were fraudulent, up from about 22% in the previous quarter.

Instead of answering a direct question and helping find common ground, Shuman responds with characteristic misdirection. First he attacks the methodology of other third party auditors with a critique that doesn’t apply to Click Forensics, then uses another third party study to claim that Google is actually charging for fewer clicks than they should.

That’s just one particular set of numbers. The auditing firm, Fair Isaac, for example, estimated in May that on Google’s content network, 10 to 15% of clicks are fraudulent. On ads placed next to search results, they said that there was a negligible rate of click fraud, less than 1%. That implies an overall click-fraud rate of around five to 7%. The number of clicks that we proactively throw out is less than 10%. So then the question is really: How much are advertisers getting for free thanks to our detection methods?

Shuman is a politician or a magician and perhaps a little of both. Instead of watching his lips, think about what he actually said and take time to do some math. The information Schuman provided proves that 22-28% of the clicks on the content network are invalid clicks.

Schuman tells us that the clicks on Google.com are only 1% invalid. Accepting that number (which seems entirely reasonable) and his implicit assertion that this represents 50% of all PPC clicks, along with the estimate that Google doesn’t bill for 10% of all PPC clicks, we can conclude that the invalid click rate for the clicks that are not on Google.com is around 19%. (1% Invalid for 50% of all clicks with 10% invalid for all clicks means 50% of the clicks have a 19% invalid rate).

Take that 50% of PPC clicks that we can infer from Shuman are not taking place on Google.com and break it down a bit more, and you wind up with some of these clicks on the Google Search Network (of which AOL and MySpace are the largest members). Google doesn’t share any data about the percentages of clicks from these partners, but if we assume that 25% of the remaining 50% of PPC clicks – or 12.5% of the overall PPC clicks -come through the Google Search Network, we wind up with 37.5% of PPC clicks coming through Google Content Network. If we assume that invalid clicks from the Search Network is half as much of a problem as on the content network, we can say that:

  • 100% of the PPC clicks have 10% invalid (Google Provided Data).
  • 50% of the PPC clicks have 1% invalid (Google Search, Schuman’s Data) .
  • 12.5% of the PPC clicks have 10% invalid (estimates for search partnership).
  • 37.5% of the PPC clicks have 22% invalid (our estimate based content/adsense advertising).

Still using Google’s 10% of all clicks are invalid, let’s go a little further and suppose that the overall share of clicks from Google.com aren’t 50%. Let’s say they are 60%, which is what we have observed with our campaigns. (again, Google won’t share these figures at the moment)

  • 60% of PPC clicks have 1% invalid (Google Search)
  • 10% of PPC clicks have (search network) have 10% invalid
  • 30% of PPC clicks have (adsense/content distribution) have 28% invalid clicks.

Clearly, this analysis is riddled with assumptions, but it is time for Google to stop responding to Click Forensics with intentionally confusing data. Come forward with a breakdown of invalid click by channel and let’s have an honest and open discussion about the remaining difference. Google might just find out that a little transparency goes a long way.

From SEO Consulting company Alchemist Media, Inc.

Rand, Foo Camp, Word Camp, SciFoo, And… Are you Busy?

We are. It’s a summer thing. It’s an SEO thing. It’s a SEARCH thing. Ain’t it grand?

Much love to Rand Fishkin of SEOmoz for the kind words after our oh-so-sunny lunch in San Francisco. We dined at Zazie, the best brunch restaurant in San Francisco. It’s one of the rare ones with a sunny, earthy, very French patio.

We also just had WordCamp here in SF, more on that soon…

What is happening right now? O’Reilly’s SciFoo (Science Foo Camp) is about to kick off at the Googleplex in Mountain View. After attending my first Foo Camp back in June, I was blown away by the brilliance and inspiration all around me… and found each night in my tent (nestled in the O’Reilly apple orchard) filled with so much intrigue that I found it difficult to sleep.

More more more will come – we promise.

Privacy Solution, Step 2– Opt Out

Imagine for a moment that we live in the hypothetical world where the search engines allow you to control your own privacy. Imagine we live in a world you are allowed to access search engines using SSL. A world where the search engines allowed you to prevent third party intermediaries from intercepting the content of our thoughts with the same minimum diligence used to protect our credit card numbers during an online transaction.

In such a Utopian society, search engines would go the next step and not log your search request if you accessed through their sites through that secure connection (unless they were already subject to a government SEARCH WARRANT to spy on you). Of course, to protect themselves and their advertisers against click fraud and address other legitimate concerns, the engines could still associate data for paid links that you clicked, for example, without saving the actual query or the organic clicks.

These steps are not the complete solution, but they are a small start to swinging the pendulum in the other direction.

Privacy Solution, Step One

Privacy International issued a “study” over the weekend which analyzed the privacy risks, policies and culture of leading websites and singled out Google as the worst offender. Many people have already weighed in on this issue, notably Danny Sulivan with Maybe It’s Privacy International’s Report That Sucks and Matt Cutts with Privacy International Loses All Credibility. Today, Google responded to the EU working group on privacy. These posts generated hundreds of comments, including a couple by yours truly.

The issues surrounding privacy are both emotional and complicated. It is hard to imagine any scenario in the digital age that will put the genie back in the bottle Every purchase you make on a credit card is reported, recorded, parsed and resold by companies like http://www.acxiom.com/ as consumer profiles. Every opinion you ever post on a forum, blog or MySpace page is permanently cached somewhere. Every search, email, text message and IM has been entered in your permanent record.

Despite these facts, search is more personal and intimate than a purchase or a rant on a blog. Search reflects our innermost thoughts, dreams and fears and contains content as well as context. Search contains thoughts we would never put in an email or send in a message to our closest friends. While it is easy to associate our concerns about search privacy with the search engines and thus launch a highly public tirade at Google (or Yahoo, MSN and Ask), the problem of privacy and search goes well beyond the engines. As Matt Cutts and others have pointed out, the greatest threat to an individual’s privacy may be their ISP.

So, here is our modest proposal for the first step to the privacy issue:
We call upon all of the search engines to default to (or at least ALLOW) encryption for searchers via SSL to prevent third parties from intercepting our searches. A quick check showed that none of the major engines allow users to access their pages via https: Ask and MSN return a 404 and Google and Yahoo redirect to http.

Default to search in the secure mode (https) so at least the content of our query is protected from all of the intermediate players and the full responsibility for protecting them is on the engines. It isn’t a solution, but it is a good first step!

Worst Search Results

The recent New York Times article about Google search contained a note that Google is always on the lookout for bad search results. They acknowledged that constant minor tweaks occasionally produce results that are low quality.

We are all aware of the occasional site that ranks and appears to defy logic, but I am curious about queries where a majority of the results, or at least the top few, are particularly irrelevant. What “normal” queries do you run that gives really bad results?