More than 1,100km from Wall Street, the New York Stock Exchange’s (NYSE) backup data center on Cermak Road in Chicago is supposed to safeguard US markets, standing by at all hours in case disaster strikes the world’s largest venue for trading shares.
When markets are closed, it participates in a well-worn routine, with NYSE staffers turning on and off systems to ensure everything works.
Heading into Tuesday, an NYSE employee failed to properly shut down Cermak’s disaster-recovery system — leading to a disaster.
That error, described by people with direct knowledge of NYSE’s internal operations, is what triggered wild market swings when trading opened on Tuesday in Manhattan. The chaos affected more than 250 companies including Wells Fargo & Co, McDonald’s Corp, Walmart Inc and Morgan Stanley, in some cases sending stock prices swinging by 25 percentage points in a matter of minutes.
The episode prompted the exchange to cancel thousands of trades at a cost that is still being determined. Meanwhile, market professionals and day traders are rattled and waiting for the exchange to elaborate on what it publicly called a “manual error” involving its “disaster recovery configuration.”
“They’re going to need to come up with something better” to reassure investors and regulators, said Joseph Saluzzi, a partner and cofounder of Themis Trading LLC, whose firm avoided losses.
“There’s zero tolerance” for systems failures “when it comes to the opening and the close,” he said.
The turmoil resulted because the backup system in Cermak was left running, misleading the exchange’s computers to treat the 9:30am opening bell as a continuation of trading, and so they skipped the day’s opening auctions, which neatly set initial prices, one of the people said.
Without that routine step, orders flowed through at prices all over the place. That soon tripped circuit breakers designed to prevent excessive market swings, setting off alarms on screens across the investing world.
NYSE executives spent hours pinpointing the problem until they were confident there would not be further fallout, the people said on condition of anonymity.
Officials also began reviewing whether the dislocated trades could be labeled “clearly erroneous” under the market’s rules and then canceled.
Shortly before 3pm on Tuesday, the exchange said it would unwind the most egregious transactions.
“A core value of [Intercontinental Exchange Inc] and the NYSE is our commitment to collaboration,” a spokesperson for NYSE said in a statement on Thursday. “The issues around our market open on Tuesday are our collective responsibility, and we have moved swiftly and decisively to resolve them as a team.”
NYSE has yet to determine how much the debacle may cost. It’s already fielding claims from firms under the exchange’s rules, the people said.
The venue gathers about US$500,000 per month for a fund to compensate exchange members — mostly broker-dealers representing their investor clients — when such mishaps occur. Decisions on claims for Tuesday’s episode are to be made by the end of the month.
Behind closed doors, NYSE executives are grappling not just with the potential cost, but the impact on the exchange’s reputation. They are in contact with regulators and lawmakers to explain what happened.
They plan to examine the platform’s procedures and management, potentially reworking rules to be more flexible and provide further protections.
The exchange had not determined as of late Wednesday whether anyone would face disciplinary action.
Intel Corp has landed Microsoft Corp as a customer for its made-to-order chip business, marking a key win for an ambitious turnaround effort under chief executive officer Pat Gelsinger. Microsoft plans to use Intel’s 18A manufacturing technology to make a forthcoming chip that the software maker designed in-house, the two companies said at an event on Wednesday. They did not identify the product, but Microsoft recently announced plans for two homegrown chips — a computer processor and an artificial intelligence (AI) accelerator. Intel has been seeking to prove it can compete in the foundry market, where companies produce custom chips for clients. It
AI EFFECT: Nvidia CEO Jensen Huang moved up to 21st on the Bloomberg Billionaires Index on Thursday after his wealth skyrocketed by US$9.6 billion to US$69.2 billion The artificial intelligence (AI) mania sparked by Nvidia Corp’s sterling results has given a lift to Asia’s major chipmakers, but it has not closed the valuation gap with their US peers. A Bloomberg gauge tracking Asia’s top semiconductor firms, including Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) and Samsung Electronics Co, widened its under-performance against the Philadelphia Semiconductor Index this week. While the Asian index trades at 17 times forward earnings, the US measure is at 27 times, pushing the gap close to a record after Nvidia’s blowout revenue outlook reinforced investor conviction in the boom in generative AI use. Nvidia’s 8 percent
The arrival of Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) in Japan’s Kumamoto Prefecture marks the regaining of the area’s pivotal position established during the Meiji Restoration in the 19th century, a local business leader said in an interview with CNA. The first fab of Japan Advanced Semiconductor Manufacturing Inc (JASM), TSMC’s majority-owned manufacturing subsidiary in Kumamoto, is set to open today. After the 1868 Meiji Restoration, Kumamoto was of key importance as it was home to a major garrison national defense. However, that position was ceded to Fukuoka after World War II as Japan turned to foreign trade for post-war economic development,
OVERSEAS: The company is expanding with OSAT development in India, an EV factory in Thailand and possibly an 12-inch fab in Malaysia, Young Liu said Hon Hai Precision Industry Co (鴻海精密), the world’s largest contract electronics maker, is expected to forge deeper and more comprehensive collaborations with its main customer Apple Inc, the company’s chairman said on Tuesday. Speaking before a dinner banquet on Tuesday to mark the company’s 50th anniversary, Hon Hai chairman Young Liu (劉揚偉) said that the two companies would forge a deeper and more extensive partnership. “Everything that should be there will be there and nothing will be missed,” Liu said, when asked about the progress made in Hon Hai’s collaborations with Apple in the artificial intelligence and electric vehicle (EV) fields. Hon