News

Spotlight: The 4 layers of big data

Bernard Marr has a good post in SmartDataCollective on the four key layers of the big data system.

5 big data mobile apps with interesting use cases

Here are five big data mobile apps designed to facilitate working with big data on a mobile device.

Discerning when we have enough analyses and where to stop

Industry analysts have predicted that there will be somewhere between 26 and 30 billion Internet of Things, or IoT, devices by the year 2020. Will all that data actually be useful? Or will the useful data only get lost in all that noise?

Big data banking battle brewing

Banks are facing some of the biggest challenges they've ever seen. Big data is the best answer to these problems but that's not to say that it's a quick and easy fix--nor is it to say that these are the only problems that need fixing.

Thunder tool library helps neuroscientists analyze brain imaging data

Among the list of more challenging data to analyze, human brain data certainly ranks high. Thunder is a library of tools built on the Apache Spark platform specifically for use in analyzing large neural data sets.

Competition seeks experts to predict and detect seizures

Researchers from the Perelman School of Medicine at the University of Pennsylvania, or Penn, and the Mayo Clinic are challenging experts in science, analytics and machine learning in two competitions on detecting and predicting seizure onset. 

Spotlight: Smarter big data security for financial services

Financial services companies should be interested in smarter computing for better and faster fraud detection, according to IBM Distinguished Engineer Jeff Calusinski.

Big data, big crashes: State Department's passport and visa database crash

The Consular Consolidated Database, or CCD, at the U.S. State Department has crashed. Significant problems have been occurring since July 19 and, as of this writing, there's no word on when the system will be back up again.

Overconfidence most common mistake in big data projects

 "The creators of big data resources like to believe that they have collected all the data relevant to their domain, that all of the data is accurate, and that the data is organized in a manner that supports meaningful data searches," Jules J. Berman, former President of the Association for Pathology Informatics, says in an interview.

Data follies: When quality data lacks context, things go bad fast

Without context, data tells you worse than nothing--it derails your efforts entirely. Such is the case in using consumer payment card and loyalty card data by healthcare providers. 

10 types of regressions worthy of review

There are hundreds of regressions but here are ten most worthy of review by data scientists and other analytic practitioners who are working with modern data. There are also specific ways to tell which of those will work best for what you're trying to accomplish. 

eBay and Redbox on their predictive analytics play

eBay and Redbox shared their uses and plans for predictive analytics at the Predictive Analytics World Conference in Chicago recently.

Big data is a business issue, not a technology issue

Companies are typically buying big data tools before they know what they want to do with them. That's like buying the best fishing pole on the market only to discover that now you have to build a house with it.

The FDA's big data hunt for drug problems in your medical records

Mini-Sentinel is a government project that proactively seeks evidence of adverse events that can be linked to drugs on the market in an effort to find and stop problems as fast as possible. It's a big data project on a specific mission and it's hunting through huge databases of medical records--and yours is probably in there somewhere.

Spotlight: Chinese military members caught hacking US companies

A grand jury in the Western District of Pennsylvania indicted five members of the Chinese military on charges of hacking and economic espionage.

Ways to win with analytics

An infographic built from a recent Lavastorm Analytics' survey will give you a good glimpse of what is going on in the analytics community.

Big data moving slowly ahead in human resources

While big data was introduced to the general public on the heels of the Snowden revelations with alarm and warning sirens, big data projects in the private sector have become so commonplace that they no longer see much fanfare. One of the quietest fronts is in human resources.

Turing Test reversal: 12 out of 13 human judges guessed wrong

On this, the 100th anniversary of Turing's birth, researchers put a test before human judges to see if they could tell whether they were conversing with another human or a machine.

Along came the Data Transparency Coalition to clear things up

The international trade group is celebrating the success of its top legislative priority: President Obama's signature on the Digital Accountability and Transparency Act, or DATA Act in May.

Top 100 eTailers use more marketing tech but their data quality is poor

Proving once again that simply owning the tech is not enough to hone a competitive edge, new research found that the top 100 online retailers still lag behind lesser ranked eTailers in data quality, despite owning more marketing technology.