A trio of LinkedIn engineers, led by Jay Kreps, is taking the Apache Kafka technology they helped create commercial. Their new company, called Confluent, wants to enable real-time data processing in all sorts of companies, and is backed by Benchmark, LinkedIn and Data Collective.
Hortonworks has added Apache Kafka to tis Hadoop software platform as a technical preview. Kafka isn’t the most popular tool in the world, but it’s widely used among large web companies, making it a useful add-on for luring customers of that ilk.
Big data startup Continuuity has teamed with AT&T Labs on an open source project called jetStream that pairs a high-throughput SQL database with a real-time data-processing engine. The goal is to underpin applications that can handle multiple levels of latency, consistency and analysis on streaming data.