Steve Tuck, general manager of Joyent Cloud, writes exclusively for CBR on how cloud providers can take on and beat Amazon
Asking whether anyone can take on Amazon in the cloud would be like someone asking Larry Page and Sergey Brin whether anyone could take on InfoSeek back in the late 1990s.
The public cloud (IaaS) market is in its infancy. Originally used for software development projects and one-time batch computing projects, today's cloud provides the foundation for Web storefronts, social networks, mobile apps, online and mobile games, and increasingly critical business services.
In a short time, the cloud will handle the traffic and computing demands of billions of devices ranging from automotive sensors, appliances, building sensors and even medical implants.
This Internet of Things may crush providers like Amazon that feature infrastructures and architectures that were never created to handle the weight of data and processing demands emerging from machine-to-machine communications.
The total IaaS global market today is $11bn, depending on who is measuring the market. That's a fraction of the global IT industry, and barely a scratch on the surface of the global telecommunications industry that tops well over $1 trillion.
Yet today's cloud has also earned a reputation for trading flexibility and low up-front costs for uncertain performance and reliability.
Already, the demands of today's mobile and Web applications and services, from games to storefronts to social networks, are overwhelming dominant cloud providers like Amazon.
No one can dispute that Amazon is the largest Cloud provider, and they played a huge role in establishing the public cloud market. They made it easy, and inexpensive for developers to use their IT infrastructure, which is the main reason Amazon Web Services dominates the market today.
Despite this early lead, it is certainly possible to compete head-to-head with Amazon. Public cloud providers can beat Amazon by delivering better performance, better visibility into their cloud, and they can actually beat Amazon on price. And you can do that if you have a better infrastructure; one that is built on a strong, resilient architecture that is designed to be efficient, resilient, and can scale to meet tomorrow's computing requirements.
Beating Amazon Performance
To beat Amazon, it's important to deliver better performance. The truth is that Amazon Web Services was never designed to handle the high-speed, production business applications running on its cloud today.
Amazon's cloud was designed to provide developers with cheap infrastructure for software development and testing, and for batch processing (such as loading a database of records into the cloud, and then running an analysis to draw conclusions from the data.
Then once you were done with the batch processing or development, you ended the contract and deleted your data.
Then developers and entrepreneurs began to build their businesses in the cloud, from e-commerce businesses, mobile and web applications and social networks. Suddenly cloud performance was directly linked to revenues.
As those cloud-based businesses grew, their traffic spiked, mobile and Web app responses began to slow because the underlying cloud infrastructure was becoming overloaded by computing and storage demand it was never designed to carry.
Providing Better Stability and Visibility into Cloud Performance
Amazon's four-day outage last year showed what can happen. If you were one of the businesses taken offline, that extended downtime meant lost revenues, and lost customers. Even worse, you had no idea why the cloud was down, because Amazon doesn't provide any way to see what's causing the outage.
Therefore, by providing better performance, stability and reliability, you can compete with Amazon, especially if you can make it easy for customers to see what's going on in your cloud, by allowing them to measure latency at each level in your cloud infrastructure, and in their application.
After all, if you can spot a minor performance issue, then you can fix it, ideally before it affects your service to your end customers, whether they use your mobile app, or your Web storefront.
Competing with Amazon Pricing
Let's be clear. Amazon's low price played a major role in gaining their dominant market position.
To beat Amazon on price, you need to have a more efficient infrastructure than Amazon's Elastic Compute Cloud (EC2). Your cloud architecture should operate efficiently using fewer servers and storage units. It should be less expensive to manage.
Scaling the Cloud to Infinity and Beyond
Customers should be able to add computing and storage capacity without multiplying their costs. With the right infrastructure, all of this is possible.
Yet with Amazon - and cloud providers that use a similar architecture - adding capacity becomes more complex as the computing load and data volumes increase. Ideally, you should double computing and storage capacity by doubling processors and storage, but with many cloud infrastructures, including Amazon's, it doesn't work that way.
Instead, inefficiencies and system complexities begin to bleed computing power, leading to a need for far more servers and storage units then more efficient architectures.
As the tsunami of data and computing demands from the Internet of Things begins to sweep through the cloud market, providers that cannot scale efficiently will be overwhelmed.
Once upon a time, it was easier for developers, entrepreneurs and IT managers to work with Amazon. That is no longer true today. While Amazon remains the dominant cloud provider, its customers are beginning to see cracks in the Amazon Cloud foundation.
For the right IaaS provider can beat Amazon head-to-head by delivering better performance, stability and scalability, and combining that with a way to see what's going on inside the cloud.
Amazon has played a critical role in building the public cloud market. Yet there is plenty of opportunity for the right provider to prosper and win as the market matures.
Steve Tuck, general manager of Joyent Cloud.