Defense Advanced Research Projects AgencyTagged Content List

Data Analysis at Massive Scales

Extracting information and insights from massive datasets; "big data"; "data mining"

Showing 98 results for Data RSS
During the 1854 cholera epidemic in London, Dr. John Snow plotted cholera deaths on a map, and in the corner of a particularly hard-hit quadrangle of buildings was a water pump. Snow's maps, a 19th-century version of big data, suggested an association between cholera and the pump, but the germ theory of disease had not yet been invented and it took human ingenuity to realize that the pump was a causal mechanism of disease transmission.
| AI | Automation | Data |
During the past decade information technologies have driven the productivity gains essential to U.S. economic competitiveness, and computing systems now control significant elements of critical national infrastructure. As a result, tremendous resources are devoted to ensuring that programs are correct, especially at scale. Unfortunately, in spite of developers’ best efforts, software errors are at the root of most execution errors and security vulnerabilities.
Information technology (IT) is a key enabler for the Defense Department (DoD) and has been a focus area for DARPA since its founding in 1958. DARPA’s contributions to modern IT are well-known—perhaps most notably, DARPA is generally credited with developing and prototyping the technology for what is now known as the Internet. But while the DoD currently enjoys IT superiority, that superiority cannot be taken for granted.
The DARPA Open Catalog—a six-month-old public web portal that organizes and shares the results of DARPA research—today expanded its research listings to include peer-reviewed publications and other material from the agency’s Biological Technologies Office (BTO) and Defense Sciences Office (DSO). Along with that expansion, the website now offers open source software, peer-reviewed publications and other research materials from the majority of programs in the agency’s Information Innovation Office (I2O) that have public information to share.
The lifelong human imperative to communicate is so strong that people talk not only to other people but also to their pets, their plants and their computers. Unlike pets and plants, computers might one day reciprocate. DARPA's new Communicating with Computers (CwC) program aims to develop technology to turn computers into good communicators.