Close Menu
TechBrunchTechBrunch
  • Home
  • AI
  • Apps
  • Crypto
  • Security
  • Startups
  • TechCrunch
  • Venture

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

What's Hot

Glow emerges from stealth with $1.2 billion valuation to take on endpoint security in the age of AI

July 22, 2026

Dimension Capital's $800 million third fund shows the intersection of science and computing is burgeoning

July 22, 2026

Breach of AI music generator Suno affects 55 million users (via Have I Been Pwned)

July 21, 2026
Facebook X (Twitter) Instagram
TechBrunchTechBrunch
  • Home
  • AI

    OpenAI seeks to extend human lifespans with the help of longevity startups

    January 17, 2025

    Farewell to the $200 million woolly mammoth and TikTok

    January 17, 2025

    Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

    January 17, 2025

    Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

    January 16, 2025

    Apple suspends AI notification summaries for news after generating false alerts

    January 16, 2025
  • Apps

    Google brings Pixel 6 and new devices to Material3 Expressive, along with other features, to the Pixel 6 and new devices

    September 3, 2025

    Google's NoteBookLM now allows you to customize the tone of your AI podcasts

    September 3, 2025

    Roblox expands the use of age estimation techniques and introduces standardized assessments

    September 3, 2025

    Instagram finally launches the iPad app

    September 3, 2025

    Complete the 2025 Confusion Builder Stage Agenda with the Maximum Scaling Voice

    September 3, 2025
  • Crypto

    Trump Meme Coin Investors Lost $3.8 Billion, Analysis Finds

    July 5, 2026

    Venice AI becomes unicorn with $65M Series A as privacy-first AI platform takes off

    July 1, 2026

    Disrupt 2026 Builders Stage Agenda Revealed

    July 1, 2026

    Crypto exchange OKX wants to hire AI agents and pay each other

    June 30, 2026

    Founder Summit early bird pricing ends tonight

    June 26, 2026
  • Security

    Glow emerges from stealth with $1.2 billion valuation to take on endpoint security in the age of AI

    July 22, 2026

    Breach of AI music generator Suno affects 55 million users (via Have I Been Pwned)

    July 21, 2026

    Hackers are exploiting a recently patched WordPress bug, putting millions of websites at risk

    July 20, 2026

    Hackers steal 'vast amounts' of data from technology company used by thousands of US hospitals and pharmacies

    July 20, 2026

    Watch Flock Safety CEO Garrett Langley talk about the future of surveillance at TechCrunch Disrupt 2026.

    July 20, 2026
  • Startups

    7 days left: Founders and VCs save over $300 on all stage passes

    March 24, 2025

    AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

    March 24, 2025

    20 Hottest Open Source Startups of 2024

    March 22, 2025

    Andrill may build a weapons factory in the UK

    March 21, 2025

    Startup Weekly: Wiz bets paid off at M&A Rich Week

    March 21, 2025
  • TechCrunch

    OpenSea takes a long-term view with a focus on UX despite NFT sales remaining low

    February 8, 2024

    AI will save software companies' growth dreams

    February 8, 2024

    B2B and B2C are not about who buys, but how you sell

    February 5, 2024

    It's time for venture capital to break away from fast fashion

    February 3, 2024

    a16z's Chris Dixon believes it's time to focus on blockchain use cases rather than speculation

    February 2, 2024
  • Venture

    Dimension Capital's $800 million third fund shows the intersection of science and computing is burgeoning

    July 22, 2026

    BlueCore Energy raises $10 million to build portable nuclear reactor on barge

    July 21, 2026

    Natural raises $30M to reinvent payments for AI agents and take on Stripe

    July 20, 2026

    Inference startup Infinity raises $15 million from Touring Capital, OpenAI, and Anthropic researchers

    July 20, 2026

    StrictlyVC returns to New York City on September 10th to celebrate a big year for the city's startup community

    July 20, 2026
TechBrunchTechBrunch

Startup Gimlet Labs solves AI inference bottlenecks in a surprisingly elegant way

TechBrunchBy TechBrunchMarch 23, 20264 Mins Read
Facebook Twitter Pinterest Telegram LinkedIn Tumblr WhatsApp Email
Share
Facebook Twitter LinkedIn Pinterest Telegram Email


Zayn Asghar, an adjunct professor at Stanford University and successful founder, has raised $80 million in Series A for a startup that cleverly solves the bottleneck problem of AI inference. The round was led by Menlo Ventures.

A company called Gimlet Labs has developed the first and only “multi-silicon inference cloud,” software that allows AI workloads to run on different types of hardware simultaneously. You can split the work of your AI apps across both traditional CPUs and AI-tuned GPUs, as well as high-memory systems.

“We basically run into different hardware that is available,” Asghar told TechCrunch.

A single agent may chain multiple steps, each of which “requires different hardware: inference is compute-dependent, decoding is memory-dependent, and tool invocation is network-dependent,” Menlo lead investor Tim Tully wrote in a blog post about the funding.

There isn't a chip to do it all yet, but as new hardware is rolled out and aging GPUs are redeployed, “a multi-silicon fleet is ready. We're just missing the software layer to make it work.” That's what Tully believes the Gimlet Institute will deliver.

If current trends in deploy-more-computing continue, McKinsey estimates that data center spending will reach nearly $7 trillion by 2030. Asghar said the app only uses the existing hardware already deployed “between 15 and 30 percent” of the time.

“The other way to think about this is that you're wasting hundreds of billions of dollars just by sitting idle resources,” he said. “Our goal was essentially to figure out how to make AI workloads 10x more efficient today than they have ever been before.”

tech crunch event

San Francisco, CA | October 13-15, 2026

So he and co-founders Michelle Nguyen, Omid Azizi, and Natalie Serrino set out to build orchestration software that could split agent workloads and distribute them across all types of hardware simultaneously.

Gimlet Labs claims that it can reliably speed up AI inference by 3x to 10x for the same cost and power. Gimlet says the underlying model can also be sliced ​​to run across different architectures, using the best chip for each part of the model.

The company already has partnerships with chip makers such as NVIDIA, AMD, Intel, ARM, Cerebras, and d-Matrix.

Gimlet's products, provided as software or through APIs to our proprietary Gimlet Cloud, are not intended for general AI app developers. For the largest AI model labs and data centers.

The company went public in October and says it has achieved eight-figure revenues (or at least $10 million) since its inception. Asghar said the customer base has more than doubled in the past four months and now includes major model manufacturers and very large cloud computing companies, but declined to name them.

The co-founders previously worked together at Pixie, a startup that developed open source observability tools for Kubernetes. Pixie was acquired by New Relic in 2020, just two months after launching in a $9 million Series A led by Benchmark. (Pixie's technology is now part of the open source organization that oversees Kubernetes.)

After Mr. Asghar met Mr. Talley by chance about a year ago and received angel investment from Stanford University professors, venture capitalists started calling. After the start, a term sheet arrived on Asgar's desk. When VCs heard that Asghar was considering an offer, the round quickly maxed out because “we had quite a lot of money,” he said.

With the previous seed, the startup has now raised a total of $92 million from a number of angels, including Sequoia's Bill Coughran, Stanford professor Nick McKeown, former CEO of VMware Raghu Raghuram, and Intel CEO Lip-Bu Tan. The company currently employs 30 people.

Other investors include Factory, which led the seed, Eclipse Ventures, Prosperity7, and Triatomic.



Source link

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

Dimension Capital's $800 million third fund shows the intersection of science and computing is burgeoning

July 22, 2026

BlueCore Energy raises $10 million to build portable nuclear reactor on barge

July 21, 2026

Natural raises $30M to reinvent payments for AI agents and take on Stripe

July 20, 2026

Inference startup Infinity raises $15 million from Touring Capital, OpenAI, and Anthropic researchers

July 20, 2026

StrictlyVC returns to New York City on September 10th to celebrate a big year for the city's startup community

July 20, 2026

Neil Reimer thinks AI money will return

July 18, 2026

Leave A Reply Cancel Reply

Top Reviews
Editors Picks

7 days left: Founders and VCs save over $300 on all stage passes

March 24, 2025

AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

March 24, 2025

20 Hottest Open Source Startups of 2024

March 22, 2025

Andrill may build a weapons factory in the UK

March 21, 2025
About Us
About Us

Welcome to Tech Brunch, your go-to destination for cutting-edge insights, news, and analysis in the fields of Artificial Intelligence (AI), Cryptocurrency, Technology, and Startups. At Tech Brunch, we are passionate about exploring the latest trends, innovations, and developments shaping the future of these dynamic industries.

Our Picks

Glow emerges from stealth with $1.2 billion valuation to take on endpoint security in the age of AI

July 22, 2026

Dimension Capital's $800 million third fund shows the intersection of science and computing is burgeoning

July 22, 2026

Breach of AI music generator Suno affects 55 million users (via Have I Been Pwned)

July 21, 2026

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

© 2026 TechBrunch. Designed by TechBrunch.
  • Home
  • About Tech Brunch
  • Advertise with Tech Brunch
  • Contact us
  • DMCA Notice
  • Privacy Policy
  • Terms of Use

Type above and press Enter to search. Press Esc to cancel.