Print 16 comment(s) - last by The Raven.. on Apr 6 at 2:30 AM

Money will go to research, domestic surveillance agencies (NSA, DHS), and emergency responder programs

Dr. John P. Holdren, Assistant to the President and Director of the White House Office of Science and Technology Policy, was on hand last Thursday to kick off the administration's "big data" push.  The Obama administration plans to allocate $200M USD in funds from the federal budget towards improving data mining by various federal agencies.

I. On the Hunt of Big Data

Dr. Holdren describes, "In the same way that past Federal investments in information-technology R&D led to dramatic advances in supercomputing and the creation of the Internet, the initiative we are launching today promises to transform our ability to use Big Data for scientific discovery, environmental and biomedical research, education, and national security."

The new push is dubbed the "The Big Data Research and Development Initiative" and it aims to mine useful information out of complex, rich data sets.

Data Mining

Projects include [PDF]:
  • A National Science Foundation (NSF) and the National Institutes of Health (NIH) project to mine imaging, molecular, cellular, electrophysiological, chemical, behavioral, epidemiological, clinical, and other data sets related to health and disease.  This project aims to extract "useful information" and create visualizations of the mined data.
  • Funding aid for the 1000 Genomes Project Data, which is hosting 200 TB of freely available genetic information on, Inc.'s (AMZN) Amazon Web Services (AWS).
  • "Earthcube", a site sponsored by the NSF and U.S. Geological Survey (USGS), aimed at sharing climate change information and other "Earth system science" data sets between researchers in a transparent manner.
  • The XDATA project sponsored by the Defense Advanced Research Projects Agency (DARPA), which aims to dissect "text documents, message traffic", as well as semi-structured data.
  • A Department of Defense (DOD) project also funded by a $250M USD DOD budget allocation, which aims to use data mining to improve deployed soldiers' situational awareness. (It sounds like this involves reading foreign language newspapers, bulletins, etc. and extracting useful information.)
  • A new supercomputing insitute, dubbed the Scalable Data Management, Analysis and Visualization (SDAV) Institute, whose focus will be on scientific data mining.  The SDAV will be a joint project between the national labs, led by Lawrence Berkeley National Laboratory.
II. But What About Domestic Spying?

Throughout the press release there's nary a mention of "national security" (outside a traditional military context) data mining programs.  However, past releases from the Obama administration have hinted at domestic surveillance data mining efforts with Orwellian names such as the U.S. National Security Agency's (NSA) "Perfect Citizen" program.

Digging into the associated longer in-depth fact sheet, however, it is revealed that the NSA will be obtaining funding for deep data mining projects, as will the U.S. Department of Homeland Security (DHS).  

The NSA mentions it will use (part) of its funding for a contest called "Vigilent Net", which will encourage private sector partners to work together in a cohesive government-aided network against (presumably) foreign threats.  The DHS effort is listed as a partnership with Rutgers University, Purdue University, and three other institutions to use data mining to "address issues ranging from manmade or natural disasters to terrorist incidents; law enforcement to border security concerns; and explosives to cyber threats."

Watchful eye
[Image Source: Alex's Archives]

Some fear that such efforts are increasingly working to comb through volumes of U.S. citizens' email, text messages, and internet posting traffic, in a warrantless effort to monitor them.  At this point information on such programs' state of completion is largely annecdotal, but it seems unlikely that they have reached a very high level of sophistication, given the federal government's general security incompetence.

For better (research) or worse (domestic surveillance) data mining looks to be a tool increasing used by the federal government and federally-funded reserachers in the years ahead, and the Obama administration's recent spending commitments have reflected that.

Interestingly the Obama administration has backed efforts to limit for-profit data mining by the private sector and create opt outs.

Sources: White House [1], [2; PDF], [3; PDF]

Comments     Threshold

This article is over a month old, voting and posting comments is disabled

RE: Communications monitoring
By Reclaimer77 on 4/2/2012 5:22:24 PM , Rating: 1
farming public information, like a public Facebook page should not.

I know what you're saying in that this is public information. Fine okay, let's sidestep that for the moment.

Just because it's "public", does that really mean our money should go to the farming of it? Does the US government have the right? We don't even have the money to be doing this.

This is simply the worst Administration of all time. Cut nothing, increase spending to infinity, trample more rights and privacy.

And this is a President and Administration who slammed Bush on wiretapping. At least that only applied if you were making an oversees call to possible terrorist states. Something the huge majority of this country never does. Obama wants the Government to literally intercept EVERYTHING the citizens of this country are doing and saying electronically.

RE: Communications monitoring
By RedemptionAD on 4/2/2012 7:14:27 PM , Rating: 2
Anyone else realize that this overmonitoring of information is a case where the government has TMI, making their information just as useless as having none at all. The computerized filtering just add more and more flags which will have soo many false postives, like a crappy anitvirus software, that it will render most actual policing of actual terrorist or otherwise threats impossable? Either way, the same flags they use to find threats can be used to steer them to wherever an intelligent person wants.

RE: Communications monitoring
By bah12 on 4/3/2012 10:03:27 AM , Rating: 2
Your right because if I search hippo on google I get nothing useful about hippos right? Google only successfully datamines the entire internet, to return useful information on hippos.


Sarcism aside, algorithms get smarter with time. It may be TMI, and too many false positives at first, but it is in those false positives that a better more accurate algorithm is refined.

Now to the subject at hand...F'em they have enough tools already, use the money for something useful.

RE: Communications monitoring
By Proxicon on 4/5/2012 10:44:53 PM , Rating: 2
I agree. Some people are just too enamored with our President. I can't believe they are actually trying to rationalize our spending on this. I heard the White House has a big propaganda dept in the basement. Maybe those people defending this is a part of it?

"And boy have we patented it!" -- Steve Jobs, Macworld 2007

Most Popular ArticlesAMD, Zen Processor might power the upcoming Apple MacBook Pro
September 30, 2016, 5:00 AM
Leaked – Samsung S8 is a Dream and a Dream 2
September 25, 2016, 8:00 AM
Are you ready for this ? HyperDrive Aircraft
September 24, 2016, 9:29 AM
Inspiron Laptops & 2-in-1 PCs
September 25, 2016, 9:00 AM
Apple’s Siri Speaker is a Game Changer
September 26, 2016, 5:00 AM

Copyright 2016 DailyTech LLC. - RSS Feed | Advertise | About Us | Ethics | FAQ | Terms, Conditions & Privacy Information | Kristopher Kubicki