A British husband-and-wife team has been waging a three-year battle to get their price comparison Web site recognized by Google in a saga that sheds new light on the power of the world’s largest search engine.
Foundem.co.uk directs shoppers to online deals for goods such as TVs or flights, but has struggled since the day it suddenly disappeared from Google search results for these categories.
There is no evidence that Google is in any way being dishonest or unfair in the way that it ranks such Web sites, but Foundem’s fight to discover what happened has highlighted the ever-growing influence of its mysterious search algorithms.
Many consumers believe Google’s search engine works on a formula that was created by founders Sergey Brin and Larry Page, and that was that: They set it running and the rest is history.
In fact, as those in the Internet industry know, Google carries out regular “tweaks” of its algorithm. About 450 a year in fact. When they are made, the sheer scale of Google — it has an estimated 90 percent market share in Britain — means these can have huge and often unintended consequences.
Another example occurred about the time Foundem saw its traffic from the site drop off, when Google stopped returning results for Amazon.com for more than a day. The Internet retailer is a household name, so not appearing in Google’s results for a time is not the end of the world. However, for a start-up company, getting into Google’s results is a question of survival.
“A typical Web site in the UK receives around two in every five visits from search engines and obviously, the vast majority of those come via Google,” according to Robin Goad, research director at Hitwise UK, an Internet traffic monitor. “For a site that is selling things like Foundem then it is up to 60 percent to 70 percent of their traffic that comes from Google. It is definitely true that if you fall foul of the rules ... it can have a massive impact on your business.”
Exactly what those rules are is far from clear because Google does not want to give too much information away in order to avoid Web developers “gaming” the system and promoting sites that are not, in fact, relevant to users. That would lead users to try other search engines and affect its traffic.
Trying to find out why exactly your site has dropped off is difficult. You can fill out an online reconsideration request, but its wording makes it quite clear that Google assumes you have done something untoward and tried to game its system.
Foundem’s Shivaun Raff explains: “We sent reconsideration requests then started sending e-mails to as many people as we could find, expecting each time that this was just a failure of process, expecting that once our case was in front of people with the power to do something it would get fixed.”
But Google insists its search rankings are only ever driven by a desire to make results useful.
“We can’t comment on individual cases,” a spokesman said. “But our systems are designed to produce the most relevant and useful results for the people who use Google search.
“Where sites are adding little value or original content, they are likely to fall in our ranking. Surveys of our users show that what they most dislike when they search is to receive multiple results from sites showing the same or very similar content,” he said.
Foundem has been able to make revenues for the operation — which consists of just the two of them and a computer programmer friend — by offering their technology to other Web publishers. Foundem, for instance, currently runs the shopping comparison service for the Web site of Bauer Media’s Motorcycle News.
To become more well known and achieve a higher position on Google as more people link to you, of course, takes advertising, but again, the might of Google dominates the online advertising market in the UK, which is why the changes that happened in the summer of 2006 to Foundem’s scores within Google AdWords platform were so worrying for the company.
AdWords allows Web users to buy keywords in an online auction environment. When the keyword is used in a search by a Google user, that auction decides which ad appears either alongside or above Google’s “natural” search results.
However, it is not quite as simple as that. A Web owner could, in fact, outbid everyone else for a keyword and still not appear on Google if it does not have a high enough “quality score” (see sidebar).
What suddenly happened to Foundem a few weeks after it disappeared from Google’s search results was that its quality scores on Adwords dropped dramatically.
“Overnight all our quality scores went from excellent or very good to poor and very poor, and our cost per click went from five pence [US$0.08] to five pounds [US$8.20],” Shivaun said.
Google’s search team had alerted the AdWords team to the fact that Foundem was a poor quality Web site. As AdWords is the part of Google that has to deal with paying customers, its processes for dealing with potential problems is far more straightforward than in search.
Foundem contacted the AdWords team and was eventually able to persuade them that its Web site was relevant to Google’s users. It took a year — and then suddenly its quality scores went back up.
“Google uses algorithmic approaches to evaluate the site quality of AdWords landing pages,” a Google spokesman said. “No algorithm is perfect, so we have systems in place for the review of penalties based on human judgment and user feedback when appropriate. All of our algorithms and decisions are focused on improving user experience.”
However, it is odd that the fact that the Google AdWords team thinks a site is relevant to Google users has no bearing on whether its search business does. The connection only works the other way: If the search team does not think a Web site is relevant to users, they alert AdWords.
Google maintains that this one-way street is critical: “One of the core principles underpinning Google’s Web search has always been that natural search rankings [are] made independently of whether a Web site advertises with us. Both natural search and AdWords make automatic quality assessments to help the ranking process, but each system looks primarily at different signals, which we publish in our guidelines.”
Exactly how AdWords operates is to be tested in the US courts by a company called TradeComet.com, owner of search engine SourceTool.com, which has accused Google of “engaging in predatory conduct to block search traffic by imposing massive, unjustified price increases” through the system.
That case, and the now three-year saga of Foundem, are likely to raise concerns about the power of Google, something already worrying politicians in Britain.
“There is a real risk that Google, entirely unintentionally, could limit innovation simply because of its dominance,” according to Peter Luff, the Conservative party’s chairman of the Business and Enterprise Committee.
“I don’t ... believe that the organization ever seeks to behave in anything but the most socially responsible way — but monopolies will always act in their own best interests, and those interests may not coincide with those of the rest of us.
“Google is just too dominant for any of us to feel entirely comfortable,” he said.
Could Asia be on the verge of a new wave of nuclear proliferation? A look back at the early history of the North Atlantic Treaty Organization (NATO), which recently celebrated its 75th anniversary, illuminates some reasons for concern in the Indo-Pacific today. US Secretary of Defense Lloyd Austin recently described NATO as “the most powerful and successful alliance in history,” but the organization’s early years were not without challenges. At its inception, the signing of the North Atlantic Treaty marked a sea change in American strategic thinking. The United States had been intent on withdrawing from Europe in the years following
My wife and I spent the week in the interior of Taiwan where Shuyuan spent her childhood. In that town there is a street that functions as an open farmer’s market. Walk along that street, as Shuyuan did yesterday, and it is next to impossible to come home empty-handed. Some mangoes that looked vaguely like others we had seen around here ended up on our table. Shuyuan told how she had bought them from a little old farmer woman from the countryside who said the mangoes were from a very old tree she had on her property. The big surprise
The issue of China’s overcapacity has drawn greater global attention recently, with US Secretary of the Treasury Janet Yellen urging Beijing to address its excess production in key industries during her visit to China last week. Meanwhile in Brussels, European Commission President Ursula von der Leyen last week said that Europe must have a tough talk with China on its perceived overcapacity and unfair trade practices. The remarks by Yellen and Von der Leyen come as China’s economy is undergoing a painful transition. Beijing is trying to steer the world’s second-largest economy out of a COVID-19 slump, the property crisis and
Former president Ma Ying-jeou’s (馬英九) trip to China provides a pertinent reminder of why Taiwanese protested so vociferously against attempts to force through the cross-strait service trade agreement in 2014 and why, since Ma’s presidential election win in 2012, they have not voted in another Chinese Nationalist Party (KMT) candidate. While the nation narrowly avoided tragedy — the treaty would have put Taiwan on the path toward the demobilization of its democracy, which Courtney Donovan Smith wrote about in the Taipei Times in “With the Sunflower movement Taiwan dodged a bullet” — Ma’s political swansong in China, which included fawning dithyrambs