What Are Neo Clouds? The New Force Reshaping Cloud Infrastructure

Neo clouds

In The Matrix, Neo discovers that the world he thought he understood isn’t quite what it seemed. The Cloud industry may be experiencing a smaller version of that moment as it considers the Neo Cloud.

So what is the Neo Cloud, and how does it impact the broader internet infrastructure industry?

Introducing the Neo Cloud

AI has opened a new sector of the Cloud market, and it’s one where hyperscalers don’t have a monopoly.

Neo Clouds are specialist providers built around accelerated computing—GPU infrastructure for AI training, fine-tuning, and inference. CoreWeave, Nebius, Lambda, Crusoe and Nscale are among the names now associated with the category. Unlike a hyperscaler, they’re not trying to cover every workload with hundreds of services. Their pitch is narrower: the right compute, networking, power and infrastructure for demanding AI workloads, delivered fast.

It sounds like a niche, and for now it’s a fairly small one. But Gartner estimates Neo Clouds could capture 20% of a $267 billion AI cloud market by 2030. The more interesting question for the wider Cloud industry isn’t how much revenue these companies pull from the hyperscalers—it’s what their rise says about the future shape of the alternative Cloud market, and the openings it creates for everyone operating around the hyperscale giants.

The Cloud doesn’t have to do everything

The original pitch for Cloud computing was convenience. Instead of buying servers, storage, and networking, you consumed infrastructure as a service. As the hyperscalers grew, that pitch got more elaborate—databases, Kubernetes, security, analytics, AI platforms, observability, serverless, and an ever-expanding catalog of managed services on top.

Neo Clouds have taken almost the opposite approach. They start with the workload, not the catalog. AI clusters need dense compute, high-bandwidth networking, fast storage, and carefully engineered interconnects—a different set of economics and architecture than a typical enterprise workload.

That’s why the better Neo Clouds aren’t just hyperscalers with more GPUs bolted on. Their infrastructure is built around the accelerator from the ground up: bare-metal or near-bare-metal access, specialized networking fabrics, and consumption models priced around GPU capacity rather than general-purpose virtual machines.

The distinction is important because the AI boom has changed what counts as the scarce resource in the Cloud. Sometimes it isn’t another CPU instance—it’s access to the right accelerator, in the right location, wired to thousands of others at the right speed. Getting that right is the Neo Cloud’s whole job.

From GPU shortage to infrastructure category

The category grew out of a practical problem: the usual channels didn’t offer enough suitable GPU capacity. AI developers needed accelerators in huge quantities. Hyperscalers had them, but demand was intense, provisioning was constrained, and GPU infrastructure was competing for attention with a much broader Cloud portfolio. That gap left room for a new layer of infrastructure provider that sits between the hardware ecosystem and the companies building AI applications.

The economics are unusual too. These are extremely capital-intensive businesses, where power availability, data-center construction, GPU procurement and financing matter as much as software. Put simply, a Neo Cloud isn’t just a new way of selling compute—it’s a new way of organizing capital, hardware, power and Cloud operations around one specific class of workload, and that’s the part worth paying attention to.

From hyperscaler to hyperspecialization

This is where the Neo Cloud story starts to matter to a much wider audience.

For years, “Alternative Cloud” has mostly meant providers operating outside the big three—regional Clouds, sovereign Clouds, hosting companies, managed service providers, telco Clouds, and specialist infrastructure operators —all serving customers for whom hyperscale isn’t always the best fit.

Neo Clouds reinforce the fact that the Alt Cloud market can compete on more than geography, price or sovereignty. It can compete on specialization.

A provider doesn’t need to build the next AWS. It needs to be exceptionally good at something the big three can’t, or won’t, optimize for in the same way—for example:

  • AI infrastructure: GPU and accelerator capacity tuned for particular workloads.
  • Sovereign AI: locally controlled infrastructure for organizations with regulatory, national-security or data-residency requirements.
  • Regional infrastructure: compute located closer to customers, data and specific jurisdictions.
  • Industry Clouds: infrastructure built around the needs of sectors like healthcare, financial services or manufacturing.
  • Specialist platforms: managed environments that abstract complexity for a particular workload without trying to reproduce the entire hyperscaler stack.
  • Hybrid infrastructure: specialist Cloud capacity integrated with customer-owned infrastructure and conventional Cloud.

That’s a far more interesting future for Alternative Cloud than competing on who can offer the slightly cheaper virtual machine.

The hyperscalers aren’t going anywhere

None of this makes the hyperscalers vulnerable across the board—quite the opposite. AI is driving extraordinary investment from them too: more data centers, more power secured, their own accelerators, AI infrastructure expanding at a remarkable clip.

The more likely outcome is layering, not replacement. A customer might train a model on a Neo Cloud, store data on a regional Cloud, lean on a hyperscaler for certain managed services, and run inference closer to users through another specialist provider. A systems integrator or MSP sits across the whole environment, handling the orchestration, security, and operational work that makes the combination actually usable.

That’s a familiar pattern in internet infrastructure: new layers create new points of interconnection, for the broader Cloud ecosystem, that might be the biggest opportunity of all.

Neo Clouds could make Cloud more diverse

There’s a bit of irony here—the first generation of Cloud computing standardized infrastructure. The next phase might make it messier again.

AI is already forcing customers to rethink where workloads run. GPU availability, power consumption, network topology, latency, data sovereignty, and accelerator architecture all factor into a workload’s economics now. The question shifts from “which Cloud are we on?” to “which infrastructure is right for this workload?”—a much more fragmented market, but fragmentation tends to create work for intermediaries.

For MSPs, integrators, connectivity providers, data-center operators, colocation companies, and specialist Cloud providers, the value increasingly lies in making that complexity disappear. Owning every piece of infrastructure may matter less than knowing which piece to use, when to use it, and how to connect it to everything else.

The Neo Cloud risks are real

Neo Clouds are also an infrastructure bet on an unusual scale. Their economics depend on expensive hardware staying productive long enough to generate a return. GPU generations move fast, customer concentration can be significant, and the industry is taking on real debt to finance expansion. Power, supply chains, construction, and financing are all places where things could go wrong.

Another obvious tension is that hyperscalers are both competitors and customers. Some Neo Clouds have benefited enormously from hyperscaler and AI-lab demand, but the more capacity the hyperscalers build themselves, the more pressure there’ll be on specialist providers to differentiate. The durable Neo Cloud pitch will need to be more than “we have GPUs”—it’ll come down to whether a provider can deliver a genuinely better combination of capacity, performance, economics, location, sovereignty, networking, operational simplicity and access to the wider ecosystem.

The bigger lesson: specialize, don’t imitate

Perhaps the most useful lesson from Neo Clouds has nothing to do with GPUs. It’s about the economics of competing with hyperscale.

Trying to rebuild a hyperscaler at smaller scale is a hard game to win. Being the best infrastructure provider for a particular workload, geography, or customer segment is a different proposition entirely—and Neo Clouds show that customers will buy from a specialist when the specialization solves a real problem.

Neo learned that there was another layer beneath the world he thought he knew. The Cloud industry may be finding something similar. The future isn’t necessarily one giant Cloud. It could be a matrix of specialized ones.

Neo Cloud Q&A

What is a Neo Cloud? A Neo Cloud is a specialist Cloud provider focused primarily on high-performance infrastructure for AI and other accelerated workloads, particularly GPU compute.

How is a Neo Cloud different from AWS, Azure or Google Cloud? The key difference is specialization. Hyperscalers offer GPUs alongside hundreds of other services; Neo Clouds design their infrastructure and operating model around accelerated computing, often with specialized networking and high-density clusters.

Who are the main Neo Cloud providers? The category includes companies such as CoreWeave, Nebius, Lambda, Crusoe, Nscale and others. The category boundaries are still evolving.

Are Neo Clouds a threat to hyperscalers? For specific AI workloads, yes. But the more likely outcome is competition alongside cooperation. Hyperscalers remain enormously powerful infrastructure providers, while Neo Clouds can fill capacity and capability gaps.

What do Neo Clouds mean for alternative cloud providers? They show there’s still room to compete with hyperscale through specialization. The opportunity isn’t necessarily to build another general-purpose Cloud, but to own a particular workload, geography, regulatory requirement or infrastructure capability.

Will Neo Clouds replace traditional Cloud providers? Probably not. The more likely future is a highly interconnected market in which hyperscalers, Neo Clouds, regional providers, colocation operators, MSPs and specialist platforms all play different roles.

Why should the wider Cloud industry care? Because Neo Clouds are an early example of a broader shift: Cloud infrastructure is becoming more workload-specific. The companies that understand how to connect and manage those specialist resources could become just as important as the companies that own the underlying compute.

This is where CloudFest comes in

These are exactly the kinds of questions that make the wider internet infrastructure world so interesting right now, and why they belong in the conversations happening at CloudFest.

CloudFest brings together the people building, operating, connecting, securing and commercializing the infrastructure behind the internet. The Neo Cloud phenomenon sits right in the middle of that world—data centers and power, networking and connectivity, GPUs and AI, Cloud platforms, sovereignty and security, and the increasingly loaded question of where computing actually happens.

CloudFest 2027 is the place to have those conversations face to face.

Registration will open soon, with more announcements, speakers, and program updates on the way. If you want to hear about it first, sign up below for the CloudFest newsletter.

Miles Kendall Avatar

This might also interest you