Close Menu
TechBrunchTechBrunch
  • Home
  • AI
  • Apps
  • Crypto
  • Security
  • Startups
  • TechCrunch
  • Venture

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

What's Hot

TC Session: AI Trivi Account Down – Next Shot in Big

May 31, 2025

Google quietly released an app that allows you to download and run AI models locally

May 31, 2025

The counted conversation begins in 5 days in a TC session: ai

May 31, 2025
Facebook X (Twitter) Instagram
TechBrunchTechBrunch
  • Home
  • AI

    OpenAI seeks to extend human lifespans with the help of longevity startups

    January 17, 2025

    Farewell to the $200 million woolly mammoth and TikTok

    January 17, 2025

    Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

    January 17, 2025

    Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

    January 16, 2025

    Apple suspends AI notification summaries for news after generating false alerts

    January 16, 2025
  • Apps

    Google quietly released an app that allows you to download and run AI models locally

    May 31, 2025

    A guide to using editing, Meta's new Capcut Rival for Short-Form video editing

    May 31, 2025

    Automattic says it will start contributing to WordPress again after pause

    May 30, 2025

    The last day to vote to destroy the 2025 agenda lineup

    May 30, 2025

    6 days left: Ready for the truth about unfiltered AI in TC sessions: AI?

    May 30, 2025
  • Crypto

    GameStop bought $500 million in Bitcoin

    May 28, 2025

    Vote for the session you want to watch in 2025

    May 26, 2025

    Save $900 + 90% from 2 tickets to destroy 2025 in the last 24 hours

    May 25, 2025

    Only 3 days left to save up to $900 to destroy the 2025 pass

    May 23, 2025

    Starting from up to $900 from Ticep, 90% off +1 in 2025

    May 22, 2025
  • Security

    8 things we learned from WhatsApp vs. NSO Group Spyware Litigation

    May 30, 2025

    White House investigates how Trump's chief staff's phone was hacked

    May 30, 2025

    US government sanctions technology company involved in cyber fraud

    May 29, 2025

    Ten years later, the bootstrap Thinkst Canary will reach $20 million ARR without VC funding

    May 29, 2025

    Security Startup Horizon3.AI raises $100 million in new rounds

    May 28, 2025
  • Startups

    7 days left: Founders and VCs save over $300 on all stage passes

    March 24, 2025

    AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

    March 24, 2025

    20 Hottest Open Source Startups of 2024

    March 22, 2025

    Andrill may build a weapons factory in the UK

    March 21, 2025

    Startup Weekly: Wiz bets paid off at M&A Rich Week

    March 21, 2025
  • TechCrunch

    OpenSea takes a long-term view with a focus on UX despite NFT sales remaining low

    February 8, 2024

    AI will save software companies' growth dreams

    February 8, 2024

    B2B and B2C are not about who buys, but how you sell

    February 5, 2024

    It's time for venture capital to break away from fast fashion

    February 3, 2024

    a16z's Chris Dixon believes it's time to focus on blockchain use cases rather than speculation

    February 2, 2024
  • Venture

    TC Session: AI Trivi Account Down – Next Shot in Big

    May 31, 2025

    The counted conversation begins in 5 days in a TC session: ai

    May 31, 2025

    TC Session: AI Trivi Account Down – Test your AI Knowledge

    May 30, 2025

    Most of the exhibit tables left to make a claim at TC at every stage | TechCrunch

    May 30, 2025

    7 days until doors open during session: ai

    May 29, 2025
TechBrunchTechBrunch

Pruna AI opens the optimization framework for AI models

TechBrunchBy TechBrunchMarch 20, 20253 Mins Read
Facebook Twitter Pinterest Telegram LinkedIn Tumblr WhatsApp Email
Share
Facebook Twitter LinkedIn Pinterest Telegram Email


Pruna AI, a European startup working on compression algorithms for AI models, has made its optimization framework open source on Thursday.

Pruna AI creates a framework that applies several efficient methods to specific AI models, such as caching, pruning, quantization, and distillation.

“We standardize the storage and loading of compression models, apply a combination of these compression methods, and evaluate the compression model after compression,” Pruna AI co-fonder and CTO John Rachwan told TechCrunch.

In particular, the Pruna AI framework can assess whether large quality losses occur after compressing the model and performance can be obtained.

“If I use metaphors, we're similar to how to embrace a standardized transformer and diffuser on the face. How to call them, how to store them, how to load them, etc. We're doing the same thing, but on efficient ways.”

Big AI Labs already uses a variety of compression methods. Openai, for example, relies on distillation to create faster versions of its flagship models.

This could be the way Openai developed the GPT-4 turbo for GPT-4. This is a faster version of GPT-4. Similarly, the Flux.1-Schnell image generation model is a distilled version of the Flux.1 model from Black Forest Labs.

Distillation is a technique used to extract knowledge from large AI models with a “teacher student” model. The developer sends requests to the teacher model and records the output. Compare the answers with the dataset and see how accurate they are. These outputs are used to train student models trained to approximate teacher behavior.

“For large companies, what they usually do is for them to build something like this in-house. And what you can find in the open source world is usually based on a single method. Let's take one method of quantization of LLMS or one method of caching a spreading model as an example,” says Rachwan. “But we can't find a tool to aggregate them all, make them all easy to use and combine them together. This is the great value that Prana brings now.”

Left to right: Rayan Nait Mazi, Bertrand Charpentier, John Rachwan, Stephan GünnemannimageCredit: Pruna ai

Pruna AI supports all types of models, from large-scale language models to spreading models, to speech to text models and computer vision models, but the company is currently focusing on image and video generation models.

Existing users of Pruna AI include scenarios and Photoroom. In addition to the open source edition, Pruna AI has an enterprise product with advanced optimization capabilities, including optimization agents.

“The most exciting feature we're releasing right away will be compressors,” Rachwan said. “Essentially, you give it your model, you say: “I need more speed, but don't drop my accuracy by more than 2%.” And the agent finds the best combination for you.

Pruna AI charges you hourly rates for the pro version. “It's similar to how you think of GPUs when renting GPUs on AWS or cloud services,” says Rachwan.

Additionally, if the model is an important part of the AI ​​infrastructure, then you'll save a lot of money with optimized model inference. For example, Pruna AI has used a compression framework to reduce the llama model by 8 times less without much loss. Pruna Ai wants customers to think of its compression framework as an investment that pays them themselves.

Pruna Ai raised $6.5 million in seed funding a few months ago. Startup investors include EQT Ventures, Daphni, Motier Ventures and Kima Ventures.



Source link

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

7 days left: Founders and VCs save over $300 on all stage passes

March 24, 2025

AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

March 24, 2025

20 Hottest Open Source Startups of 2024

March 22, 2025

Andrill may build a weapons factory in the UK

March 21, 2025

Startup Weekly: Wiz bets paid off at M&A Rich Week

March 21, 2025

Wayve CEO shares his key elements for scaling autonomous driving technology

March 21, 2025

Leave A Reply Cancel Reply

Top Reviews
Editors Picks

7 days left: Founders and VCs save over $300 on all stage passes

March 24, 2025

AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

March 24, 2025

20 Hottest Open Source Startups of 2024

March 22, 2025

Andrill may build a weapons factory in the UK

March 21, 2025
About Us
About Us

Welcome to Tech Brunch, your go-to destination for cutting-edge insights, news, and analysis in the fields of Artificial Intelligence (AI), Cryptocurrency, Technology, and Startups. At Tech Brunch, we are passionate about exploring the latest trends, innovations, and developments shaping the future of these dynamic industries.

Our Picks

TC Session: AI Trivi Account Down – Next Shot in Big

May 31, 2025

Google quietly released an app that allows you to download and run AI models locally

May 31, 2025

The counted conversation begins in 5 days in a TC session: ai

May 31, 2025

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

© 2025 TechBrunch. Designed by TechBrunch.
  • Home
  • About Tech Brunch
  • Advertise with Tech Brunch
  • Contact us
  • DMCA Notice
  • Privacy Policy
  • Terms of Use

Type above and press Enter to search. Press Esc to cancel.