Big data

A data visualization created by IBM shows that big data such as Wikipedia edits by bot Pearle are more meaningful when enhanced with colors and position.

In information technology, big data consists of data sets that grow so large and complex that they become awkward to work with using on-hand database management tools. Difficulties include capture, storage,search, sharing, analytics, and visualizing. This trend continues because of the benefits of working with larger and larger data sets allowing analysts to "spot business trends, prevent diseases, combat crime."Though a moving target, current limits are on the order of petabytes, exabytes and zettabytes of data. Scientists regularly encounter this problem in meteorology, genomics,connectomics, complex physics simulations, biological and environmental research,Internet search, finance and business informatics. Data sets also grow in size because they are increasingly being gathered by ubiquitous information-sensing mobile devices, aerial sensory technologies (remote sensing), software logs, cameras, microphones, Radio-frequency identification readers, and wireless sensor networks.The world’s technological per capita capacity to store information has roughly doubled every 40 months since the 1980s (about every 3 years)and every day 2.5 quintillion bytes of data are created.