More than 1,100km from Wall Street, the New York Stock Exchange’s (NYSE) backup data center on Cermak Road in Chicago is supposed to safeguard US markets, standing by at all hours in case disaster strikes the world’s largest venue for trading shares.
When markets are closed, it participates in a well-worn routine, with NYSE staffers turning on and off systems to ensure everything works.
Heading into Tuesday, an NYSE employee failed to properly shut down Cermak’s disaster-recovery system — leading to a disaster.
Photo: Bloomberg
That error, described by people with direct knowledge of NYSE’s internal operations, is what triggered wild market swings when trading opened on Tuesday in Manhattan. The chaos affected more than 250 companies including Wells Fargo & Co, McDonald’s Corp, Walmart Inc and Morgan Stanley, in some cases sending stock prices swinging by 25 percentage points in a matter of minutes.
The episode prompted the exchange to cancel thousands of trades at a cost that is still being determined. Meanwhile, market professionals and day traders are rattled and waiting for the exchange to elaborate on what it publicly called a “manual error” involving its “disaster recovery configuration.”
“They’re going to need to come up with something better” to reassure investors and regulators, said Joseph Saluzzi, a partner and cofounder of Themis Trading LLC, whose firm avoided losses.
“There’s zero tolerance” for systems failures “when it comes to the opening and the close,” he said.
The turmoil resulted because the backup system in Cermak was left running, misleading the exchange’s computers to treat the 9:30am opening bell as a continuation of trading, and so they skipped the day’s opening auctions, which neatly set initial prices, one of the people said.
Without that routine step, orders flowed through at prices all over the place. That soon tripped circuit breakers designed to prevent excessive market swings, setting off alarms on screens across the investing world.
NYSE executives spent hours pinpointing the problem until they were confident there would not be further fallout, the people said on condition of anonymity.
Officials also began reviewing whether the dislocated trades could be labeled “clearly erroneous” under the market’s rules and then canceled.
Shortly before 3pm on Tuesday, the exchange said it would unwind the most egregious transactions.
“A core value of [Intercontinental Exchange Inc] and the NYSE is our commitment to collaboration,” a spokesperson for NYSE said in a statement on Thursday. “The issues around our market open on Tuesday are our collective responsibility, and we have moved swiftly and decisively to resolve them as a team.”
NYSE has yet to determine how much the debacle may cost. It’s already fielding claims from firms under the exchange’s rules, the people said.
The venue gathers about US$500,000 per month for a fund to compensate exchange members — mostly broker-dealers representing their investor clients — when such mishaps occur. Decisions on claims for Tuesday’s episode are to be made by the end of the month.
Behind closed doors, NYSE executives are grappling not just with the potential cost, but the impact on the exchange’s reputation. They are in contact with regulators and lawmakers to explain what happened.
They plan to examine the platform’s procedures and management, potentially reworking rules to be more flexible and provide further protections.
The exchange had not determined as of late Wednesday whether anyone would face disciplinary action.
UNCONVINCING: The US Congress questioned whether the company’s Chinese owners pose a national security risk and how the app might influence young users TikTok chief executive officer Shou Chew (周受資), confronted with an unforgiving, distrustful US Congress, tried to give answers in his testimony on Thursday that avoided offending either the US government or China. However, his evasiveness left Congress unsatisfied, with representatives hungrier than ever to punish TikTok for ties to its parent company ByteDance Ltd (字節跳動), based in Beijing. He did not bring his company any closer to a resolution. Politically, TikTok is in a tougher spot. Its executives had been discussing divesting from ByteDance to resolve US national security concerns, people familiar with the matter told Bloomberg. However, China this week said
Sanofi SA’s drug Dupixent succeeded in a late-stage trial for chronic obstructive pulmonary disease (COPD), raising the odds that the blockbuster would be the first biologic medicine cleared to treat the lung disorder. Dupixent, which is already prescribed for asthma and some skin conditions, showed a 30 percent reduction in the rate at which patients’ COPD worsened compared with those who received a placebo during the stage-three Boreas trial, the company said in a statement yesterday. The positive data could herald a new era of cutting-edge treatments for the life-threatening respiratory affliction and provide another major boost in demand for the French
Huawei Technologies Co (華為) has replaced more than 13,000 parts in its products that were hit by US trade sanctions, the Chinese tech giant’s founder said, according to a speech transcript from last month posted on Friday by a Chinese university. Ren Zhengfei (任正非) said Huawei had over the past three years replaced the 13,000 components with domestic Chinese substitutes, and had redesigned 4,000 circuit boards for its products, the transcript posted by Shanghai Jiao Tong University said. “As of now, our circuit board [production] has stabilized, because we have a supply of domestically produced components,” Ren said. He did not give details
SEMICONDUCTOR EQUIPMENT: The international trade group said the sector would recover from a slump, with spending expected to rise 4.2 percent to US$24.9 billion Taiwan is to retain its position as the top spender on semiconductor front-end equipment and facilities next year, with spending expected to increase 4.2 percent year-on-year to US$24.9 billion, international trade group SEMI said yesterday. The spending forecast matches an expected recovery in global semiconductor equipment and facilities investment next year, it said. International equipment spending is to return to growth next year, SEMI said in a report, forecasting 21 percent growth to US$92 billion. The expansion would manly be driven by robust demand for semiconductors in the automotive and high-performance computing segments, the association said. “This quarter’s SEMI World Fab Forecast update