Spotlight: TED Talk in big data as better data

Kenneth Cukier, Data Editor of The Economist, presented a TED Talk on big data and what's next for machine learning.

New big data management platform aims to stop energy theft

Delta just announced its new Intelligent Distribution Analytics Platform designed to warn electric, gas, and water utilities of critical issues in real-time.

'Experience design' the latest fashion in big data trends

"Experience design" is a product or service design that focuses on and caters to the user experience. Consider it the natural course of personalization. 

'Realtors are in the business of big data whether they know it yet or not' says nation's top real estate broker

Real estate brokers are no longer solely focused on what data buyers want to have, but on data that can place a broker directly in front of a seller at exactly the right moment too.

Big data in market correction predictions, investment models

Vasant Dhar, professor at NYU Stern School of Business, is recommending that investors seriously consider big data based sentiment as an input in investment decision making.

Moving from big data to smart data

Data hoarders are no longer trendy, but rather seen as in need of a good data warehouse cleaning. So now the new trend is to move to "smart data"--which is to say relevant data.

Spotlight: Don't let big data become big trouble

The article in in The Register--titled "Make sure big data doesn't land you in big trouble,"--looks at several issues IT must resolve in using big data.

Data ownership question may shut that whole Internet of Things down

There's a problem with the Internet of Things. It's the question of who owns the data devices collect. The entire Internet of Things could be entirely derailed shortly if the official answer favors consumers, says Alex "Sandy" Pentland.

Farmers Coalition strikes accord on data privacy, security with agriculture tech providers

The American Farm Bureau Federation  has announced a coalition to resolve data issues, including ownership, privacy and security, between farmers and agriculture technology providers. Yes, everything is clear as mud now. What could possibly go wrong?

Formula 1 amps up terabytes used in the race

You may recall a post from last year on how big data was being used by Formula One race teams wherein it was reported that "approximately 240 sensors generate 25 megabytes of data per lap with which engine and chassis performance is analyzed." But, oh my, the speed with which that data is growing rivals the Formula One cars themselves. 

IU SciPass in beta, aims to securely speed large data transfers

Like many institutions, Indiana University was frustrated with using Science DMZ to optimize large data transfers because although it has many security features, those same features significantly slow the transfers. SciPass, software now in beta, is IU's pass at finding a better, faster way to handle data transfers. 

Your cash cow is dying. Now what?

Many conservative business leaders got confused over what they were to conserve. Somehow they came to think they should protect the cash cow rather than the cash. However, it is a fact of life that no matter how well you tend to that cash cow, that sucker is going to die one day. Then what are you going to do?

Hortonworks' IPO testing investor tolerance for operating losses

You've likely heard that Hortonworks filed an IPO last week and you've no doubt heard much cheering around it. Indeed, it signals many great things such as the maturation of the big data market in general and Hadoop in particular. But, the IPO filing reveals some $87 million in operating losses and precious few revenues. So, is it the potential gold in the IPO or the glitter in the operating losses that presents the biggest lesson for the big data industry?

LinkedIn open sources Cubert

LinkedIn uses a framework called Cubert (a nod to the Rubik's Cube) to organize data, speed queries and preserve CPU resources. This week LinkedIn open sourced Cubert. Here's what you need to know and where to find everything you need to use it. 

Retailer websites outpace Amazon, eBay on Black Friday, Cyber Monday

Stitch Labs has done the analysis on more than 300,000 orders from the Wednesday before Thanksgiving to the Tuesday after Cyber Monday in 2013 and found a few shockers in the results. 

Resistance to Hadoop is futile, says Forrester

Forrester analysts say in a new report that Hadoop is no longer an option but a necessity for all businesses. The report also predicts that SQL will become Hadoop's killer app next year. But is it true that Hadoop is the be all, end all in big data? Let's take a look. 

Spotlight: Net neutrality now a political football, outcome could affect cost of data transfers

No doubt you heard President Obama urged the FCC to protect net neutrality this week. But the conversation in the capitol has degraded according to an eWeek report. While the President does not have...

China accused of USPS breach, but could it have been a data broker?

The United States Postal Service, or USPS, reported this week that it was hacked. The breach affects over 800,000 employees and all customers who contacted the agency by phone or email between January 1 and August 16, 2014.

Google Flu Trends gets a data makeover

There was much ado last year when Google Flu Trends overshot the mark. Google is making changes in Flu Trends for this season, including incorporating the CDC's traditional data, for a more comprehensive analysis. 

Spotlight: Big data takes a look at the Underground Railroad

Slate looks at the impact of big data on civil liberties, discrimination and the concept of personal freedom.