Gimlet Labs has raised $300 million in Series B funding led by Andreessen Horowitz, valuing the AI infrastructure company at $3 billion and bringing its total funding to $392 million. Sapphire Ventures participated as a major investor, while M12 and Arm joined as new investors. Existing investors Menlo Ventures and Factory also participated in the round.
San Francisco-based Gimlet Labs is developing a multi-silicon inference cloud for agentic AI, designed to run AI workloads across multiple types of processors rather than relying on a single hardware architecture.
The company’s software disaggregates AI models and assigns different phases of inference workloads to the hardware best suited for each task, with the goal of improving latency, throughput, utilization and power efficiency.
Gimlet works with major AI chip companies including NVIDIA, AMD, Intel, Arm, Cerebras and d-Matrix, allowing its infrastructure to support a combination of GPUs, CPUs and purpose-built AI accelerators.
The company emerged from stealth in October 2025 with what it describes as the industry’s first multi-silicon inference software designed specifically for faster and more interactive agentic AI workloads.
Gimlet’s technology is available through its own managed cloud as well as through managed deployments within customer environments.
The financing follows a period of rapid commercial expansion.
In March 2026, Gimlet said it had tripled its customer base and added one of the top three frontier AI labs and one of the top three hyperscalers as customers.
Since then, the company has secured billions of dollars in contracted revenue for Gimlet Cloud and is scaling its managed heterogeneous infrastructure to hundreds of megawatts.
Gimlet plans to use the new capital to expand operations for its multi-silicon cloud and continue growing its team.
The company is positioning its architecture around the growing infrastructure demands created by agentic AI applications, which can generate enormous volumes of inference activity and require increasingly low-latency responses.
Gimlet’s platform combines multi-silicon data centers, inference software and intelligent orchestration across compute nodes.
Its data center architecture can integrate GPUs, CPUs and purpose-built accelerators, including SRAM-based architectures, within a unified system.
Gimlet said its inference software can achieve up to 10 times gains in throughput and interactivity by matching different stages of AI workloads with optimized hardware architectures.
The approach is also designed to improve utilization of limited computing hardware and electricity, potentially reducing the infrastructure footprint and cost required to serve large AI inference workloads.
The broader market opportunity is expanding rapidly as AI spending shifts toward inference. Gimlet cited Goldman Sachs estimates that the industry could spend approximately $765 billion on AI capital expenditures in 2026 and $7.6 trillion cumulatively from 2026 through 2031.
KEY QUOTES:
“AI demand is growing exponentially, while data centers and silicon can’t keep pace. The answer isn’t just more infrastructure – it’s a better architecture. Gimlet has built a new kind of inference cloud, heterogeneous by design, that matches each workload to the right silicon. By making GPUs and purpose-built accelerators work as one system, Gimlet delivers dramatically more throughput, more interactivity and more intelligence from every watt. We believe this is where inference infrastructure is headed.”
Raghu Raghuram, Managing Partner at Andreessen Horowitz and Gimlet Labs Board Member
“We’ve reached a turning point where inference is the dominant AI workload and the demand for tokens is explosive. With Gimlet, our customers are able to serve massive volumes of tokens at very low latency, even as their AI workloads continue to grow across all dimensions. We’re able to deliver unprecedented performance because Gimlet software intelligently slices and orchestrates their workloads across different types of hardware from both mainstream and emerging chipmakers.”
Zain Asgar, Co-Founder and CEO of Gimlet Labs