Yes, there is a big data revolution afoot and this time around things are getting real!
While some data will also be proprietary and closely guarded, the vast majority of data will be joined to the open data movement. Why? Because the more data people can access, the more discoveries can be made.
U.S. politics is not the only place you'll find big data at work. It's increasingly used in countries around the world with mixed results. Indeed, it is at the core of elections now underway in India.
You've heard me and several others repeatedly say that the term big data is unfortunate because it's really not about the size of the data, but about the complexity of the computing. In other words, big data tools are not contained to usage where there are petabytes of data. Those tools are useful with just about any sized data if you're doing complex computing with it.
Big data technologies and techniques are maturing but they are far from mature. The good news is that everything's headed in the right direction. Eventually we will master the whole shebang and things will get easier. Meanwhile, here are five trends that are driving us forward…
Automotive manufacturers currently have to assume costly manufacturing errors in their balance sheet: namely a rainy day piggy bank for the inevitable recalls and litigation costs. Predictive diagnostics can quickly change that scenario by finding problems in vehicles before they start killing people and ringing up the jury awards. The question is, will big data inform automakers that taking the litigation risk may actually be cheaper than fixing the problems? And if so, which path will automakers choose to take?
And if you want to make any real progress in business intelligence, it's best to ask them all to walk into your business. Here's why...
One of the chief advantages in using big data is in enforcement of all kinds. Why? Because it pulls information out of hiding and makes offenses glaringly recognizable to those charged with policing.
Face it, business users love their spreadsheet. They do! Now they can do big data on Excel too! Bottom line: Microsoft just hit the sweet spot in corporate data democratization and BI adoption at the user level.
I see your face and know your name (and a bunch of other stuff about you) using a face recognition and big data cocktail. But let's face it, what we really want to do is count calories without actually counting them or typing a bunch of questionable numbers in an app. Now we can with DataAet ORANGE. Ok. So it's a prototype but it's still cool. Here's how it works…