Structure 2010: How Does a Company Scale in Real Time?

Network engineers from Yahoo (s yhoo), Facebook, PayPal and Zynga told the GigaOM Structure conference that startups and other companies need to think about how they’re going to scale their information infrastructure as they grow. However, the panel said that companies also need to recognize that their predictions will probably be wrong, and look at using cloud computing services to make it easier to adapt that infrastructure later.

Mark Williams, vice-president of network operations for Zynga, said that one of the things cloud computing has done is to provide a relatively manageable number of infrastructure pieces — whether it’s servers, software or a combination of the two — that a company can put together to scale quickly. Zynga, for example, doesn’t know what kind of demand or traffic a new game will produce when it first launches, so the company focuses on having a suite of infrastructure pieces “and then the network team works with the developers and we can swap those pieces out if we need to, and experiment in real time to solve those challenges.”

Facebook’s VP of technical operations, Jonathan Heiliger, said one thing the company has found as it’s grown to more than 400 million users is that whenever it predicts that demand for a new feature or service will be really high, it isn’t, and “when we predict it will be really low, it turns out to be really high.” Jay Parikh, the director of engineering at the social network, said one thing the company does is to try new features with a small group of users “so we can see what adoption rates are like, and then to extrapolate to what it’s going to be like when you turn it on across 400 million users.”

Todd Papaioannou, VP of cloud infrastructure at Yahoo, said that people like to say scaling problems are good problems to have, since it means a company is growing. But companies need to try and think about scaling issues as early as possible when they’re building their systems, “because you’re going to be stuck with them for a long time,” and it’s going to be very difficult and very painful to go back and re-architect later.

Meanwhile, PayPal’s VP of customer quality, Matthew Mengerink, said that companies also need to focus on developing a business model that allows for such incorrect predictions, because they will happen and companies will have to re-architect their infrastructure. “You can’t predict the future or what yo’ure going to need,” he said, and if you don’t spend time on your business model, “you won’t have a scale problem because you won’t have any customers.”

gigaomtv on Broadcast Live Free