When you read or hear the term "Big Data" what do you think about? Do you visualize an extremely large database or data warehouse? Do you think about architectures and algorithms for storing and processing big data? When haven’t we had big data in relation to the systems and services that we are asked to program? Is yesterday’s big data small data today? With the Internet and the number of humans creating and consuming data, I guess we do have really big data today and it is only getting bigger. When I see a temperature rise in the number of articles, blog posts, conferences and books that appear on a topic, I love to dig into the topic.
Here are a number of links to articles that I’ve been reading about big data:
- What is "Big Data?" - ZDNet
- The Pathologies of Big Data - ACM Queue
- Big Data to Drive a Surveillance Society - ComputerWorld
- Business Information consumption: 9,570,000,000,000,000,000,000 Bytes Per Year (9.57 zettabytes) - USCD
- Big Data processing with Hadoop - NotFluffJustStuff.com
- A free Visual Programming Language for Big Data - ReadWriteWeb.com
- Big Data for Science Workshop - Indiana University
- A Conversation with IBM’s Mr. Big Data - Infoworld
- Strata 2011 - O’Reilly’s Strata Making Data Work Conference
- Thoughts on the O’Reilly 2011 Strata Big Data Conference - Business Intelligence from the Swamp
- Big Data - Wikipedia
- Group Seeks Global Protocol to Identify Big Data Sets - Science Magazine
- Expert Panel: What’s Around the Bend for Big Data? - HP InTheCloud
To paraphrase some lines from the Beatles song "It’s Getting Better All The Time" (apologies to John, Paul, George and Ringo):
I used to get mad at my data
The databases I used weren’t cool
You data has grown, relations complex
We might partially blame George Boole.
I’ve got to admit data’s getting bigger
A little bigger all the time
I have to admit data’s getting bigger
It’s getting bigger since you’ve been online.
How big is your data? Is it getting even bigger? What architectures and tools are you using to mine it and keep it under control?