A survey of US federal agencies has found more than 120 programs that collect and analyze large amounts of personal data on individuals to predict their behavior.
The survey, which was to be issued yesterday by the General Accounting Office, an investigative arm of Congress, found that the practice, known as data mining, was ubiquitous.
In canvassing federal agencies, the accounting office found that 52 were systematically sifting through computer databases. These agencies reported 199 data mining projects, of which 68 were planned and 131 were in operation. At least 122 of the 199 projects used identifying information like names, e-mail addresses, Social Security numbers and driver's license numbers.
The survey provides the first authoritative estimate of the extent of data mining by the government. It excludes most classified projects, so the actual numbers are likely to be much higher.
The Defense Department made greatest use of the technique, with 47 data mining projects to track everything from the academic performance of Navy midshipmen to the whereabouts of ship parts and suspected terrorists.
Privacy
Democratic Senator Daniel Akaka, who requested the report by the accounting office, said: "I am disturbed by the high number of data mining activities in the federal government involving personal information. The government collects and uses Americans' personal information and shares it with other agencies to an astonishing degree, raising serious privacy concerns."
A federal advisory committee appointed by Secretary of Defense Donald Rumsfeld said last week that Congress should pass laws to protect the civil liberties of Americans when the government scans computer records and data files for information about terrorists.
Newton Minow, chairman of the committee, said he and other panel members would present their report to Rumsfeld yesterday.
Hidden patterns
The panel said federal agencies should generally be required to obtain court approval "before engaging in data mining with personally identifiable information" on US citizens. It also said that federal investigators should, if possible, work with anonymous data, stripped of personal identifiers, and use the minimum amount of data needed to achieve their purpose.
The panel was created to quell an uproar over a Pentagon plan to hunt terrorists by monitoring e-mail messages and fishing through huge databases of financial, medical and travel information.
The accounting office defined data mining as the use of sophisticated technology, statistical analysis and modeling to uncover hidden patterns and subtle relationships in data, and to infer rules that allow for the prediction of future activity.
Of the 199 data mining projects, 54 use information from the private sector, like credit reports and records of credit card transactions. Seventy-seven projects use data obtained from other federal agencies, like student loan records, bank account numbers and taxpayer identification numbers.
In its catalog of data mining, the accounting office listed these projects.
The Internal Revenue Service mines financial data to predict which individual tax returns have the greatest potential for fraud and which corporations are most likely to make improper use of tax shelters.
No limits
The Defense Intelligence Agency mines data from the intelligence community and searches the Internet to identify people, including US citizens, who are most likely to have connections to foreign terrorist activities.
The Department of Homeland Security seeks clues to possible terrorist activity by looking for patterns in myriad records of crimes, arrests and unusual behavior, traffic tickets and incidents involving the possession of firearms.
James Dempsey, executive director of the Center for Democracy and Technology, a civil liberties group, said: "In many cases, the private sector is subject to stricter standards than the government. The Fair Credit Reporting Act, for example, imposes limits on commercial uses of personal financial and other data, but there are virtually no limits on government uses."
Dempsey said the Constitution provided little protection to an individual with personal information stored in a commercial database to which the government gained access. The Supreme Court has held that a person has no legitimate "expectation of privacy" in information held by a bank or other third party, because the materials are business records, not private papers.
STEPPING UP: Diminished US polar science presence mean opportunities for the UK and other countries, although China or Russia might also fill that gap, a researcher said The UK’s flagship polar research vessel is to head to Antarctica next week to help advance dozens of climate change-linked science projects, as Western nations spearhead studies there while the US withdraws. The RRS Sir David Attenborough, a state-of-the-art ship named after the renowned British naturalist, would aid research on everything from “hunting underwater tsunamis” to tracking glacier melt and whale populations. Operated by the British Antarctic Survey (BAS), the country’s polar research institute, the 15,000-tonne icebreaker — boasting a helipad, and various laboratories and gadgetry — is pivotal to the UK’s efforts to assess climate change’s impact there. “The saying goes
FRUSTRATIONS: One in seven youths in China and Indonesia are unemployed, and many in the region are stuck in low-productivity jobs, the World Bank said Young people across Asia are struggling to find good jobs, with many stuck in low-productivity work that the World Bank said could strain social stability as frustrations fuel a global wave of youth-led protests. The bank highlighted a persistent gap between younger and more experienced workers across several Asian economies in a regional economic update released yesterday, noting that one in seven young people in China and Indonesia are unemployed. The share of people now vulnerable to falling into poverty is now larger than the middle class in most countries, it said. “The employment rate is generally high, but the young struggle to
ENERGY SHIFT: A report by Ember suggests it is possible for the world to wean off polluting sources of power, such as coal and gas, even as demand for electricity surges Worldwide solar and wind power generation has outpaced electricity demand this year, and for the first time on record, renewable energies combined generated more power than coal, a new analysis said. Global solar generation grew by a record 31 percent in the first half of the year, while wind generation grew 7.7 percent, according to the report by the energy think tank Ember, which was released after midnight yesterday. Solar and wind generation combined grew by more than 400 terawatt hours, which was more than the increase in overall global demand during the same period, it said. The findings suggest it is
TICKING CLOCK: A path to a budget agreement was still possible, the president’s office said, as a debate on reversing an increase of the pension age carries on French President Emmanuel Macron yesterday was racing to find a new prime minister within a two-day deadline after the resignation of outgoing French Prime Minister Sebastien Lecornu tipped the country deeper into political crisis. The presidency late on Wednesday said that Macron would name a new prime minister within 48 hours, indicating that the appointment would come by this evening at the latest. Lecornu told French television in an interview that he expected a new prime minister to be named — rather than early legislative elections or Macron’s resignation — to resolve the crisis. The developments were the latest twists in three tumultuous