LinkedIn has made Kafka Monitor, a framework for monitoring and testing Kafka deployments, open source, and it's now available on Github. It continuously monitors SLAs in production clusters and runs regression tests in test clusters.
Confluent launched Kafka Streams, a lightweight product for stream processing development. It's part of the now generally released open source Confluent Platform 3.0 which also features Confluent's first commercial product, the Confluent Control Center, for managing Kafka Clusters.
The Large Synoptic Survey Telescope (LSST), the largest digital camera in the world once completed in 2020, is slated to make the world's first motion picture of our universe. While some are fascinated and eager to see that "movie," it's the data that it will produce that will intrigue and occupy scientists for decades.
New perils in health data reporting crop up regularly, but a recent HIPAA compliant against Myriad Genetics for withholding variant data from patients is an unexpected development. The company did not include in its data report to patients any data deemed to be benign or clinically insignificant – but, as it turns out, the patients wanted that data too. Heads up: this could signify a major change in companies' claims of data ownership.
IBM scientists successfully demonstrated storing 3 bits of data per cell on a comparatively new memory technology called phase-change memory (PCM). This breakthrough is hailed as vital for fast and easy storage of extreme data sizes from mobile and the Internet of Things due to its read/write speed, endurance, density, and non-volatility.
Tuesday at SAPPHIRE NOW, MapR unveiled its new Quick Start Migration Service to assist users migrating to MapR from other Hadoop distributions. It also assists users of the new appliance recently announced by Cisco for SAP HANA since that includes the MapR Converged Data Platform.
Dell announced a new release of SharePlex, its database replication and near real-time data integration product. The new release will be generally available on May 24. Among its features are added support for SAP HANA, Teradata, and EnterpriseDB Postgres. It enables users to replicate Oracle data directly to all three.
The Office of the National Coordinator for Health Information Technology (ONC), an U.S. Department of Health & Human Services agency, has launched its Move Health Data Forward Challenge for developers and IT experts. The contest is to create an API to the implementation specifications developed by the HEART Workgroup to allow individuals to share their health data anywhere they choose, such as with clinicians, clinical researchers, hospitals, or family members.
Blazegraph announced version 2.1.0 of its graph database which features geospatial and improved semantic searching and optimized queries against the National Center for Biotechnology Information's (NCBI) PubChem database. New tools make semantic search usable on even the largest data published in the Linked Open Data structure.
The first ever global topographic map of Mercury was released by the U.S. Geological Survey, Arizona State University, Carnegie Institute of Washington, Johns Hopkins University Applied Physics Laboratory and NASA. It was built from the largest dataset ever processed by the USGS Astrogeology Science Center.