Hurricane Frances was on its way, barreling across the Caribbean, threatening a direct hit on Florida's Atlantic coast. Residents made for higher ground, but far away, in Bentonville, Arkansas, executives at Wal-Mart Stores decided that the situation offered a great opportunity for one of their newest data-driven weapons, something that the company calls predictive technology.
A week ahead of the storm's landfall, Linda Dillman, Wal-Mart's chief information officer, pressed her staff to come up with forecasts based on what had happened when Hurricane Charley struck several weeks earlier. Backed by the trillions of bytes' worth of shopper history that is stored in Wal-Mart's computer network, she felt that the company could "start predicting what's going to happen, instead of waiting for it to happen," as she put it.
PHOTO: NYTIMES
The experts mined the data and found that the stores would indeed need certain products -- and not just the usual flashlights.
"We didn't know in the past that strawberry Pop-Tarts increase in sales, like seven times their normal sales rate, ahead of a hurricane," Dillman said in a recent interview. "And the pre-hurricane top-selling item was beer."
Thanks to those insights, trucks filled with toaster pastries and six-packs were soon speeding down Interstate 95 toward Wal-Marts in the path of Frances. Most of the products that were stocked for the storm sold quickly, the company said.
Such knowledge, Wal-Mart has learned, is not only power. It is profit, too.
Plenty of retailers collect data about their stores and their shoppers, and many use the information to try to improve sales. Target Stores, for example, introduced a branded Visa card in 2001 and has used it, along with an arsenal of gadgetry, to gather data ever since. But Wal-Mart amasses more data about the products it sells and its shoppers' buying habits than anyone else, so much so that some privacy advocates worry about potential for abuse.
With 3,600 stores in the US and roughly 100 million customers walking through the doors each week, Wal-Mart has access to information about a broad slice of America -- from individual Social Security and driver's license numbers to geographic proclivities for Mallomars, or lipsticks or jugs of antifreeze. The data are gathered item by item at the checkout aisle, then recorded, mapped and updated by store, by state, by region.
By its own count, Wal-Mart has 460 terabytes of data stored on Teradata mainframes, made by NCR, at its Bentonville headquarters. To put that in perspective, the Internet has less than half as much data, according to experts.
Information about products, and often about customers is most often obtained at checkout scanners. Wireless hand-held units, operated by clerks and managers, gather more inventory data. In most cases, such detail is stored for indefinite lengths of time. Sometimes it is divided into categories or mapped across computer models, and it is increasingly being used to answer discount retailing's rabbinical questions, like how many cashiers are needed during certain hours at a particular store.
All of the data are precious to Wal-Mart. The information forms the basis of the sales meetings the company holds every Saturday, and it is shot across desktops throughout its headquarters and into the places where it does business around the world. Wal-Mart shares some information with its suppliers -- a company like Kraft, for example, can tap into a private extranet, called Retail Link, to see how well its products are selling. But for the most part, Wal-Mart hoards its information obsessively.
It also takes pains to keep the information secret. Some of the systems it uses are custom-built and designed by its own employees, the better to keep competitors off the trail. Companies that sell equipment and software to Wal-Mart are bound by nondisclosure agreements. Three years ago, Wal-Mart summarily announced that it would no longer share its sales data with outside companies, like Information Resources Inc. and ACNielsen, which had paid Wal-Mart for the information and then sold it to other retailers.
With so much data at Wal-Mart's corporate fingertips, what are the risks to consumers? Most have no clue that their habits are monitored to such an extent. There are no signs -- like the ones for Wal-Mart's anti-shoplifting cameras -- advising customers that information is being collected and stored. And there is no giveback: Wal-Mart doesn't use loyalty cards and rarely offers promotions based on past purchases.
It is aware, however, that shoppers are concerned about privacy. On its Web site, Wal-Mart posts a privacy policy that states: "We take reasonable steps to protect your personal information. We maintain reasonable physical, technical and procedural measures to limit access to personal information to authorized individuals with appropriate purposes."
Not everyone agrees. "People don't know that Wal-Mart is capturing information about who they are and what they bought, but they are also capable of capturing a huge amount of outside information about them that has nothing to do with their grocery purchases," said Katherine Albright, the founder and director of Caspian, a consumer advocacy group concerned with privacy issues.
"They can find out your mortgage amounts, your court dates, your driving record, your creditworthiness."
One source of information can be a credit card or a debit card, Albright said. Wal-Mart shoppers increasingly use the cards to pay for purchases, particularly in the better-heeled neighborhoods where the company has been building stores recently.
Wal-Mart uses its mountain of data to push for greater efficiency at all levels of its operations, from the front of the store, where products are stocked based on expected demand, to the back, where details about a manufacturer's punctuality, for example, are recorded for future use. The purpose is to protect Wal-Mart from a retailer's twin nightmares: too much inventory, or not enough.
Still, achieving sleeker operations is not the whole story. In many ways, data are used to forecast and drive Wal-Mart's business.
"We use it in real estate decisions, understanding what the draw is like and what the customers will be like," Dillman said.
Eventually, some experts say, Wal-Mart will use its technology to institute what is called scan-based trading, in which manufacturers own each product until it is sold.
"Wal-Mart will never take those products onto its books," said Bruce Hudson, a retail analyst at the Meta Group, an information technology consulting firm in Stamford, Connecticut.
"If you think of the impact of shedding US$50 billion of inventory, that is huge."
The impact will probably be felt by suppliers, he added, but none are likely to complain.
"You can see the pattern of Wal-Mart's mandates, and as Wal-Mart grows in power, it is getting more dictatorial," he said. "The suppliers shake their heads and say, `I don't want to go this way, but they are so big.' Wal-Mart lives in a world of supply and command, instead of a world of supply and demand."
NO-LIMITS PARTNERSHIP: ‘The bottom line’ is that if the US were to have a conflict with China or Russia it would likely open up a second front with the other, a US senator said Beijing and Moscow could cooperate in a conflict over Taiwan, the top US intelligence chief told the US Senate this week. “We see China and Russia, for the first time, exercising together in relation to Taiwan and recognizing that this is a place where China definitely wants Russia to be working with them, and we see no reason why they wouldn’t,” US Director of National Intelligence Avril Haines told a US Senate Committee on Armed Services hearing on Thursday. US Senator Mike Rounds asked Haines about such a potential scenario. He also asked US Defense Intelligence Agency Director Lieutenant General Jeffrey Kruse
INSPIRING: Taiwan has been a model in the Asia-Pacific region with its democratic transition, free and fair elections and open society, the vice president-elect said Taiwan can play a leadership role in the Asia-Pacific region, vice president-elect Hsiao Bi-khim (蕭美琴) told a forum in Taipei yesterday, highlighting the nation’s resilience in the face of geopolitical challenges. “Not only can Taiwan help, but Taiwan can lead ... not only can Taiwan play a leadership role, but Taiwan’s leadership is important to the world,” Hsiao told the annual forum hosted by the Center for Asia-Pacific Resilience and Innovation think tank. Hsiao thanked Taiwan’s international friends for their long-term support, citing the example of US President Joe Biden last month signing into law a bill to provide aid to Taiwan,
China’s intrusive and territorial claims in the Indo-Pacific region are “illegal, coercive, aggressive and deceptive,” new US Indo-Pacific Commander Admiral Samuel Paparo said on Friday, adding that he would continue working with allies and partners to keep the area free and open. Paparo made the remarks at a change-of-command ceremony at Joint Base Pearl Harbor-Hickam in Hawaii, where he took over the command from Admiral John Aquilino. “Our world faces a complex problem set in the troubling actions of the People’s Republic of China [PRC] and its rapid buildup of forces. We must be ready to answer the PRC’s increasingly intrusive and
STATE OF THE NATION: The legislature should invite the president to deliver an address every year, the TPP said, adding that Lai should also have to answer legislators’ questions The Chinese Nationalist Party (KMT) yesterday proposed inviting president-elect William Lai (賴清德) to make a historic first state of the nation address at the legislature following his inauguration on May 20. Lai is expected to face many domestic and international challenges, and should clarify his intended policies with the public’s representatives, KMT caucus secretary-general Hung Meng-kai (洪孟楷) said when making the proposal at a meeting of the legislature’s Procedure Committee. The committee voted to add the item to the agenda for Friday, along with another similar proposal put forward by the Taiwan People’s Party (TPP). The invitation is in line with Article 15-2