Report: Docker and the Linux container ecosystem

Our library of 1700 research reports is available only to our subscribers. We occasionally release ones for our larger audience to benefit from. This is one such report. If you would like access to our entire library, please subscribe here. Subscribers will have access to our 2017 editorial calendar, archived reports and video coverage from our 2016 and 2017 events.
Image 1 for post Navicron- Linux emerges as clear winner in mobile applications( 2008-02-07 22:25:59)
Docker and the Linux container ecosystem by Janakiram MSV:
Linux container technology is experiencing tremendous momentum in 2014. The ability to create multiple lightweight, self-contained execution environments on the same Linux host simplifies application deployment and management. By improving collaboration between developers and system administrators, container technology encourages a DevOps culture of continuous deployment and hyperscale, which is essential to meet current user demands for mobility, application availability, and performance.
Many developers interchange the terms “container” and “Docker,” sometimes making it difficult to distinguish between the two, but there is a very important distinction. Docker, Inc. is a key contributor to the container ecosystem in the development of orchestration tools and APIs. While container technology has existed for decades, the company’s open-source platform, Docker, makes that technology more accessible by creating simpler and more powerful tools. Using Docker, developers and system administrators can efficiently manage the lifecycle of tens of thousands of containers.
This report provides a detailed overview of the Linux container ecosystem. It explains the various components of container technology and analyzes the ecosystem contributions from companies to accelerate the adoption of Linux-based containers.
To read the full report click here.

Datadog buys Mortar Data, will close its Hadoop cloud service

Datadog, a startup that monitors the performance of users’ cloud computing servers, has acquired big data startup Mortar Data and intends to shutter the company’s existing cloud service.

Mortar launched in 2012 and was initially focused on providing a simple way to run Hadoop jobs in the Amazon Web Services cloud using languages such as Python and Pig. The company eventually launched an open source project to house a lot of its work, including some around building reusable frameworks for common big data applications such as recommendation engines. Recently, Mortar added support for numerous new open source technologies, including Spotify’s Luigi pipeline tool and Apache Spark.

The company had raised $3.2 million in equity and debt financing, including a $1.8 million seed round, according to Crunchbase.

Datadog will be closing down Mortar’s service, and the Mortar team and platform will work inside Datadog analyzing operational data that can be turned into additional analytics for users. Datadog was already a Mortar user. In fact, Chief Product Officer Amit Agarwal said in an interview about the acquisition, “Mortar was our Hadoop, for the most part . . . We already had a common law relationship.”

Datadog has raised more than $50 million in venture capital since launching in 2010, including a recently announced $31 million round.

Mortar Co-founder and CEO K Young said his company is “taking a lot of care” right now to ensure users have a smooth transition away from the hosted Mortar platform. Part of that process involves releasing a lot more components into the open source repository, he said.

Mortar Data had a solid idea and was one of the first to market with a cloud-based Hadoop service, but apparently the company’s approach didn’t resonate with consumers. Or perhaps its business model didn’t scale. I used to compare Mortar to Infochimps and Continuuity, the former of was acquired by CSC in 2013 while trying to raise money and the latter of which changed its name to Cask and open sourced its technology.

Even if you’re focused on data scientists or developers, it’s difficult to compete in the world of big data infrastructure without very deep pockets. Similar startups that have launched since Mortar, including Altiscale and Qubole, raised significantly more capital and appear to be doing decent business. Databricks, the unofficial corporate arm of the Apache Spark project, has also raised boatloads of capital and is banking on a cloud computing service, as well.

That’s not to mention the difficulty of selling users on your service when the cloud providers themselves — particularly [company]Amazon[/company], [company]Microsoft[/company] and [company]Google[/company] — continue rolling out bigger, cheaper and fast data services.

We’ll be talking more about the still-emerging big data market at our Structure Data conference next month in New York. Executives from the world’s leading big data software vendors and cloud providers, as well as many cutting-edge users, will be discussing where the business is headed and what technologies are the next big things.

Cloud monitoring category gets busier

Server monitoring gets hot

SolarWinds, which monitors multi-vendor technologies running in house, last week bought Librato to extend its reach into the cloud. Librato is noted for its ability to watch workloads running in Heroku and Amazon Web Services as well is in internally-run Rails, Node.js, Ruby, Rails and Java applications.

Austin, Texas-based SolarWinds is betting that, despite the hype, most companies will not move everything to a public cloud or a SaaS vendor but will want ways to monitor workloads whether they are running in the server room down the hall, in AWS US-East or wherever.

For the $40 million purchase price SolarWinds “gets a way to bridge on-prem and cloud worlds and provide visibility across both,” Kevin Thompson, Solarwinds president, (pictured above) said in an interview.

The goal is to give “IT and devops pros a way to manage everything from on-prem to cloud and everything in between or we can’t guarantee a level of performance,” he said.

That’s a tall order. But it’s also a potentially huge market as it’s increasingly clear that most big tech buyers will continue to spread their bets between private and public resources.

[company]Solarwinds[/company] will not, however, meld Librato’s cloud monitoring service in with its existing services but rather field discrete services so customers can buy what they need, he said.

It started down this road to cloud by purchasing Pingdom, a website and application monitoring company, in June. Librato is more about monitoring infrastructure at all layers in cloud environments, according to SolarWinds.

There’s been a flurry of activity in server monitoring over the past year. In May, Google purchased StackDriver, which provided monitoring tools for AWS and Google Cloud Platform. Three months later Idera bought Copperegg, another server monitoring product.

Investors are paying attention. Last week another server monitoring entry, Datadog, snagged $31 million in new funding bringing its total funding to more than $50 million. Other entries in this space include Boundary and Server Density.

What’s that again? Amazon to break out its cloud numbers?

But the really big news in cloud last week was all about AWS accounting. [company]Amazon[/company] always talks about how transparent it is. And yet,  the size of its clearly huge AWS business was treated like a state secret, hidden inside another category — which also includes sales of various and sundry other stuff including co-branded credit cards.  That left pundits to guestimate its size. (My favorite anecdote is when an Amazon employee complained to me about [company]Microsoft[/company] being opaque in claiming Azure was a $1 billion business a few years back. FWIW, I agreed that the Azure number was fuzzy at best, but oh the irony that Amazon, of all companies would complain about that.

Sooo, when, on the Q4 earnings call Thursday,  Amazon’s CFO said the company would at last break out AWS numbers, starting this quarter, I had to triple check the news. Make no mistake, this is a big deal, but the break out of cloud numbers won’t necessarily illuminate all mysteries. But baby steps, people.

The down side? Our nifty “Amazon North America Net Sales (other)” chart now can be retired. So here it is one more time (along with associated growth chart.)

[dataset id=”911024″]

[dataset id=”911074″]

Structure Show! All about data!

Check out this week’s Structure Show as data nerd Derrick Harris talks to data nerd Matt Ocko, of Data Collective Venture Capital, about real opportunities (a la beyond the hype) for big data technologies. DCVC has put seed money into database companies (MemSQL) and satellite companies (Planet Labs).

And if that chat leaves you wanting more, you can get it when Ocko speaks at Structure Data next month in New York). Last week’s guest, Hilary Mason will be there as well. So come for an embarrassment of data riches; stay for the parties!


[soundcloud url=”″ params=”color=ff5500&auto_play=false&hide_related=false&show_comments=true&show_user=true&show_reposts=false” width=”100%” height=”166″ iframe=”true” /]




Hosts: Barb Darrow and Derrick Harris.

Download This Episode

Subscribe in iTunes

The Structure Show RSS Feed


Datadog fetches $31M to beef up sales and engineering

Datadog, which promises to let companies see how well (or badly) their various cloud deployments are performing, now has $31 million in fresh Series C funding, bringing its total to about $53 million.

The company, with offices in New York and Boston, will use the new funding to hire more people in sales and R&D, CEO Olivier Pomel said in an interview. This round was led by existing investor Index Ventures, with participation from RTP Ventures, OpenView Venture Partners, Amplify Partners and others.

Datadog CEO Olivier Pomel

Datadog CEO Olivier Pomel

“Our ecosystem is blowing up, in a good way,” Pomel said. “Two years ago it was all [company]Amazon[/company]. Now there’s also [company]Microsoft[/company] Azure and [company]Google[/company] on the public cloud side. They’re building fast and are serious. On the private side, back then there was OpenStack on the private side, and now there’s an explosion of container technology driven by Docker and now CoreOS … Every single big software company has a container play and we have to support all that.”

The company, which claims [company]Netflix[/company], Spotify, [company]EA[/company], and, Mercadolibre as customers, has 75 employees now, up from 25 last year, and plans to double or triple headcount next year.

Datadog faces competitors including Boundary, Server Density and Stackdriver (which was purchased by [company]Google[/company] last year). Pomel said many customers use home-grown options.