Latest Commentary

Big data putting the brakes on mastectomy

Big advances are just as likely found in analyzing what we are already doing, and in finding and cutting the things we thought worked, but actually don't. Case in point: new research found up to 60,000 American women diagnosed with early stage breast cancer unnecessarily undergo lumpectomies, mastectomies, or double mastectomies.

LinkedIn open sources Gradle plugin for Hadoop devs

If you're writing Hadoop jobs using Gradle as your build system, you'll likely want to check out this plugin. 

Preview of this week's Joint Statistical Meetings

The 2015 Joint Statistical Meetings is happening in Seattle this week. A glance at the agenda offers significant insights into just how far big data and statistical advances are affecting everyday life now – from personalized medicine to the human microbiome and health care to demographic analysis and business analytics to law enforcement.

The big data pigeonhole problem

For many companies, big data amounts to a black hole wherein a lot of data is sucked in never to be seen again. Fortunately some of those companies are already on their way to sorting that problem out – cleaning and labeling data and setting the data center to rights so that the data can be found and analyzed. But today, we're going to ignore the black hole and focus on the opposite challenge: the pigeonhole problem found in outputs. 

Voice biometrics used to identify taxpayers

The first deployment was of Nuance's Vocal Password product wherein customers speak a simple passphrase; the second phase was a deployment of the FreeSpeech product that matches the caller's voice to voice patterns in the database. How did taxpayer voice patterns get into a government database? The taxpayers themselves put them there. 

Smart Cities under construction: No car ownership, no waiting rooms, instant transportation/deliveries, and more

Smart cities, aka Intelligent Cities, may sound futuristic. Actually, most of the technology needed to make them happen already exists and is being deployed to varying degrees in cities around the globe.

Why IT is losing its grip on big data

When most people think of big data they think of IT. After all, that's been the traditional home of data, data professionals, and the source of almost all reports. But that is changing rapidly as both the C-suite and line of business analysts aggressively seek to circumvent IT in a hurry. Now, why would that be?

IU researchers map entire global economy, forecast large-scale industrial evolution

"We're not only trying to give everyone a 'map,' or a large-scale picture of all the sectors of the economy, but also a 'weather forecast' and 'tools,'" Ahn said in a statement to the press.

"So users will not only know where they can find jobs but also predict bright spots on the horizon – the emerging markets – and acquire the skills, or tools, they will need to get where they want to go."

Uncle Sam moves to a new school district, seeks big data teachers

The Pentagon has learned a valuable lesson: It needs to learn a lot more about handling big data. While an admirable admission and pursuit, it's how the Pentagon is going about the pursuing that's raising a few eyebrows – and more than a little hope for government eventually getting up to speed.

LinkedIn's Pinot Analytics goes open source

Last fall, LinkedIn introduced Pinot and hopes to make it open source, which FierceBigData reported on at that time. Last week, the Pinot as open source became a reality. LinkedIn also open sourced Burrow, a "new method for monitoring Kafka consumers."