Data Management and Migration

Latest Headlines

Latest Headlines

LinkedIn makes Kafka Monitor open source

LinkedIn has made Kafka Monitor, a framework for monitoring and testing Kafka deployments, open source, and it's  now available  on Github. It continuously monitors SLAs in production clusters and runs regression tests in test clusters.

Confluent launches real-time Kafka Streams

Confluent launched Kafka Streams, a lightweight product for stream processing development. It's part of the now generally released open source Confluent Platform 3.0 which also features Confluent's first commercial product, the Confluent Control Center, for managing Kafka Clusters.

World's largest digital camera to generate huge scientific datasets on billions of galaxies

The Large Synoptic Survey Telescope (LSST), the largest digital camera in the world once completed in 2020, is slated to make the world's first motion picture of our universe. While some are fascinated and eager to see that "movie," it's the data that it will produce that will intrigue and occupy scientists for decades.

Patients file HIPAA complaint against genetics firm for withholding data

New perils in health data reporting crop up regularly, but a recent HIPAA compliant against Myriad Genetics for withholding variant data from patients is an unexpected development. The company did not include in its data report to patients any data deemed to be benign or clinically insignificant – but, as it turns out, the patients wanted that data too. Heads up: this could signify a major change in companies' claims of data ownership.

IBM Research makes storage memory breakthrough

IBM scientists successfully demonstrated storing 3 bits of data per cell on a comparatively new memory technology called phase-change memory (PCM).  This breakthrough is hailed as vital for fast and easy storage of extreme data sizes from mobile and the Internet of Things due to its read/write speed, endurance, density, and non-volatility.

MapR unveils Quick Start Migration Service

Tuesday at SAPPHIRE NOW, MapR unveiled its new Quick Start Migration Service to assist users migrating to MapR from other Hadoop distributions. It also assists users of the new appliance recently announced by Cisco for SAP HANA since that includes the MapR Converged Data Platform.

Dell announces new SharePlex release

Dell  announced  a new release of SharePlex, its database replication and near real-time data integration product. The new release will be generally available on May 24.  Among its features are added support for SAP HANA, Teradata, and EnterpriseDB Postgres. It enables users to replicate Oracle data directly to all three.

HHS launches health data API challenge to enable patients to share their own data

The Office of the National Coordinator for Health Information Technology (ONC), an U.S. Department of Health & Human Services agency, has launched its Move Health Data Forward Challenge for developers and IT experts. The contest is to create an API to the implementation specifications developed by the HEART Workgroup to allow individuals to share their health data anywhere they choose, such as with clinicians, clinical researchers, hospitals, or family members.

Blazegraph 2.1.0 Graph Database features geospatial search, PubChem data processing

Blazegraph announced version 2.1.0 of its graph database which features geospatial and improved semantic searching and optimized queries against the National Center for Biotechnology Information's (NCBI) PubChem database. New tools make semantic search usable on even the largest data published in the Linked Open Data structure. 

Global topographic map of Mercury created from "largest dataset ever processed"

The first ever global topographic map of Mercury was released by the U.S. Geological Survey, Arizona State University, Carnegie Institute of Washington, Johns Hopkins University Applied Physics Laboratory and NASA. It was built from the largest dataset ever processed by the USGS Astrogeology Science Center.