Datadog buys Mortar Data, will close its Hadoop cloud service

Datadog, a startup that monitors the performance of users’ cloud computing servers, has acquired big data startup Mortar Data and intends to shutter the company’s existing cloud service.

Mortar launched in 2012 and was initially focused on providing a simple way to run Hadoop jobs in the Amazon Web Services cloud using languages such as Python and Pig. The company eventually launched an open source project to house a lot of its work, including some around building reusable frameworks for common big data applications such as recommendation engines. Recently, Mortar added support for numerous new open source technologies, including Spotify’s Luigi pipeline tool and Apache Spark.

The company had raised $3.2 million in equity and debt financing, including a $1.8 million seed round, according to Crunchbase.

Datadog will be closing down Mortar’s service, and the Mortar team and platform will work inside Datadog analyzing operational data that can be turned into additional analytics for users. Datadog was already a Mortar user. In fact, Chief Product Officer Amit Agarwal said in an interview about the acquisition, “Mortar was our Hadoop, for the most part . . . We already had a common law relationship.”

Datadog has raised more than $50 million in venture capital since launching in 2010, including a recently announced $31 million round.

Mortar Co-founder and CEO K Young said his company is “taking a lot of care” right now to ensure users have a smooth transition away from the hosted Mortar platform. Part of that process involves releasing a lot more components into the open source repository, he said.

Mortar Data had a solid idea and was one of the first to market with a cloud-based Hadoop service, but apparently the company’s approach didn’t resonate with consumers. Or perhaps its business model didn’t scale. I used to compare Mortar to Infochimps and Continuuity, the former of was acquired by CSC in 2013 while trying to raise money and the latter of which changed its name to Cask and open sourced its technology.

Even if you’re focused on data scientists or developers, it’s difficult to compete in the world of big data infrastructure without very deep pockets. Similar startups that have launched since Mortar, including Altiscale and Qubole, raised significantly more capital and appear to be doing decent business. Databricks, the unofficial corporate arm of the Apache Spark project, has also raised boatloads of capital and is banking on a cloud computing service, as well.

That’s not to mention the difficulty of selling users on your service when the cloud providers themselves — particularly [company]Amazon[/company], [company]Microsoft[/company] and [company]Google[/company] — continue rolling out bigger, cheaper and fast data services.

We’ll be talking more about the still-emerging big data market at our Structure Data conference next month in New York. Executives from the world’s leading big data software vendors and cloud providers, as well as many cutting-edge users, will be discussing where the business is headed and what technologies are the next big things.

Google takes on AWS CloudWatch with a monitor of its own

Google is moving ahead with the integration of Stackdriver technology with a new beta of Google Cloud Monitoring. Google bought Stackdriver, a Boston-based provider of cross-cloud monitoring tools, last May and announced an alpha release of the tool at Google Platform Live a month later.

The new beta, which will compete with Amazon Web Services’ CloudWatch, will initially focus solely on Google Cloud Platform (GCP). The goal remains to provide a single way to watch workloads across public (including AWS) and hybrid clouds, according a blog post by Google product manager (and Stackdriver Co-founder) Dan Belcher. No timing on the non-Google cloud support was given but in an email message but in a follow-up email, Belcher said the company remains committed to providing a single tool to monitor applications across Google Cloud Platform, AWS and hybrid environments.

He added that Stackdriver (I guess that means Google now) added AWS Kinesis integration for existing Stackdriver customers.

 

According to the post, all GCP customers, as opposed to a select subset, can now use the monitor to see how their Google App Engine, Google Compute Engine, Cloud Pub/Sub and Cloud SQL workloads are doing.

The monitor promises metrics to help admins gauge the general health of their resources — users can create aggregate views of their key systems and bring in custom metrics. From there, they can create custom dashboards of what they want to watch. It also provides data on usage, up-time, performance and incidents where alerting policies are violated, according to the blog.

Stackdriver filled in a check box on Google’s to-do list of what it needs to gain credibility among enterprise accounts, where admins really need a window into what’s going on in their public cloud workloads.

Google Cloud Monitor

Google adds a big data service and lots of monitoring to its cloud

Google rolled out a slew of new cloud services at I/O, including one called Dataflow that’s meant to put standard MapReduce to shame. It’s advertised a much simpler way to build data pipelines that can handle both batch processing and streaming data.

Rackspace launches cloud monitor

Rackspace CTO John Engates said the company’s new monitoring service, based on its Cloudkick acquisition two years ago, will give customers a better way to monitor the performance of their cloud resources. As more companies consider cloud deployment, tools like these are becoming essential.

Today in Cloud

Cloudability was definitely one of the more interesting startups to pitch at GigaOM Structure back in June, and today the company transitioned its product from private to public beta. Cloudability tracks spending on over 80 cloud services from Amazon Web Services to Salesforce, with a mix of screen-scraping and API calls, and presents the result in easily digestible form. Alerts flag unexpected spikes in usage (those big — expensive — EC2 instances you started on Friday afternoon, and forgot to shut down again), and the service will also begin to offer advice on ways to reduce costs. Cloudability could be of great value to startups and small companies using a spread of cloud-based services, but the team also report at least one Fortune 500 company as “one of our more active users.”