Close Menu
TechBrunchTechBrunch
  • Home
  • AI
  • Apps
  • Crypto
  • Security
  • Startups
  • TechCrunch
  • Venture

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

What's Hot

Ring cameras and doorbells now use AI to provide specific descriptions of motion activities

June 25, 2025

Julie Bornstein's Daydream is releasing AI-powered chatbots for fashion-related shopping

June 25, 2025

The $1,200 tequila on the all-in-podcast is already sold out

June 24, 2025
Facebook X (Twitter) Instagram
TechBrunchTechBrunch
  • Home
  • AI

    OpenAI seeks to extend human lifespans with the help of longevity startups

    January 17, 2025

    Farewell to the $200 million woolly mammoth and TikTok

    January 17, 2025

    Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

    January 17, 2025

    Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

    January 16, 2025

    Apple suspends AI notification summaries for news after generating false alerts

    January 16, 2025
  • Apps

    Julie Bornstein's Daydream is releasing AI-powered chatbots for fashion-related shopping

    June 25, 2025

    iPhone customers who are upset by Apple wallet ads are pushing F1 movies

    June 24, 2025

    ElevenLabs releases a standalone voice generation app

    June 24, 2025

    With Chrome on Android, you can now move the address bar to the bottom.

    June 24, 2025

    Google brings historical street view images to Google Earth

    June 24, 2025
  • Crypto

    Stablecoin Evangelist: Katie Haun's Battle of Digital Dollars

    June 22, 2025

    Hackers steal and destroy millions of Iran's biggest crypto exchanges

    June 18, 2025

    Unique, a new social media app

    June 17, 2025

    xNotify Polymarket as partner in the official forecast market

    June 6, 2025

    Circle IPOs are giving hope to more startups waiting to be published to more startups

    June 5, 2025
  • Security

    Ring cameras and doorbells now use AI to provide specific descriptions of motion activities

    June 25, 2025

    The US bans WhatsApp from House of Leprancatives Staff Devices

    June 24, 2025

    According to Canada, the carrier was breached by China-related spying hacking

    June 23, 2025

    US insurance giant AFLAC says customer personal data was stolen during a cyber attack

    June 23, 2025

    Iran's government says it will shut down the internet to protect against cyber attacks

    June 20, 2025
  • Startups

    7 days left: Founders and VCs save over $300 on all stage passes

    March 24, 2025

    AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

    March 24, 2025

    20 Hottest Open Source Startups of 2024

    March 22, 2025

    Andrill may build a weapons factory in the UK

    March 21, 2025

    Startup Weekly: Wiz bets paid off at M&A Rich Week

    March 21, 2025
  • TechCrunch

    OpenSea takes a long-term view with a focus on UX despite NFT sales remaining low

    February 8, 2024

    AI will save software companies' growth dreams

    February 8, 2024

    B2B and B2C are not about who buys, but how you sell

    February 5, 2024

    It's time for venture capital to break away from fast fashion

    February 3, 2024

    a16z's Chris Dixon believes it's time to focus on blockchain use cases rather than speculation

    February 2, 2024
  • Venture

    The $1,200 tequila on the all-in-podcast is already sold out

    June 24, 2025

    Katie Haun on genius behavior and what it might mean for the future of code

    June 24, 2025

    WISPR Flow raises $30 million from Menlo Ventures for its AI-powered Dictation app

    June 24, 2025

    Learn what to confuse 2025 and make a bitchland

    June 24, 2025

    Thanks to Fidelity and our sponsors, TC All Stage is where startups rise

    June 24, 2025
TechBrunchTechBrunch

Pruna AI opens the optimization framework for AI models

TechBrunchBy TechBrunchMarch 20, 20253 Mins Read
Facebook Twitter Pinterest Telegram LinkedIn Tumblr WhatsApp Email
Share
Facebook Twitter LinkedIn Pinterest Telegram Email


Pruna AI, a European startup working on compression algorithms for AI models, has made its optimization framework open source on Thursday.

Pruna AI creates a framework that applies several efficient methods to specific AI models, such as caching, pruning, quantization, and distillation.

“We standardize the storage and loading of compression models, apply a combination of these compression methods, and evaluate the compression model after compression,” Pruna AI co-fonder and CTO John Rachwan told TechCrunch.

In particular, the Pruna AI framework can assess whether large quality losses occur after compressing the model and performance can be obtained.

“If I use metaphors, we're similar to how to embrace a standardized transformer and diffuser on the face. How to call them, how to store them, how to load them, etc. We're doing the same thing, but on efficient ways.”

Big AI Labs already uses a variety of compression methods. Openai, for example, relies on distillation to create faster versions of its flagship models.

This could be the way Openai developed the GPT-4 turbo for GPT-4. This is a faster version of GPT-4. Similarly, the Flux.1-Schnell image generation model is a distilled version of the Flux.1 model from Black Forest Labs.

Distillation is a technique used to extract knowledge from large AI models with a “teacher student” model. The developer sends requests to the teacher model and records the output. Compare the answers with the dataset and see how accurate they are. These outputs are used to train student models trained to approximate teacher behavior.

“For large companies, what they usually do is for them to build something like this in-house. And what you can find in the open source world is usually based on a single method. Let's take one method of quantization of LLMS or one method of caching a spreading model as an example,” says Rachwan. “But we can't find a tool to aggregate them all, make them all easy to use and combine them together. This is the great value that Prana brings now.”

Left to right: Rayan Nait Mazi, Bertrand Charpentier, John Rachwan, Stephan GünnemannimageCredit: Pruna ai

Pruna AI supports all types of models, from large-scale language models to spreading models, to speech to text models and computer vision models, but the company is currently focusing on image and video generation models.

Existing users of Pruna AI include scenarios and Photoroom. In addition to the open source edition, Pruna AI has an enterprise product with advanced optimization capabilities, including optimization agents.

“The most exciting feature we're releasing right away will be compressors,” Rachwan said. “Essentially, you give it your model, you say: “I need more speed, but don't drop my accuracy by more than 2%.” And the agent finds the best combination for you.

Pruna AI charges you hourly rates for the pro version. “It's similar to how you think of GPUs when renting GPUs on AWS or cloud services,” says Rachwan.

Additionally, if the model is an important part of the AI ​​infrastructure, then you'll save a lot of money with optimized model inference. For example, Pruna AI has used a compression framework to reduce the llama model by 8 times less without much loss. Pruna Ai wants customers to think of its compression framework as an investment that pays them themselves.

Pruna Ai raised $6.5 million in seed funding a few months ago. Startup investors include EQT Ventures, Daphni, Motier Ventures and Kima Ventures.



Source link

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

7 days left: Founders and VCs save over $300 on all stage passes

March 24, 2025

AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

March 24, 2025

20 Hottest Open Source Startups of 2024

March 22, 2025

Andrill may build a weapons factory in the UK

March 21, 2025

Startup Weekly: Wiz bets paid off at M&A Rich Week

March 21, 2025

Wayve CEO shares his key elements for scaling autonomous driving technology

March 21, 2025

Leave A Reply Cancel Reply

Top Reviews
Editors Picks

7 days left: Founders and VCs save over $300 on all stage passes

March 24, 2025

AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

March 24, 2025

20 Hottest Open Source Startups of 2024

March 22, 2025

Andrill may build a weapons factory in the UK

March 21, 2025
About Us
About Us

Welcome to Tech Brunch, your go-to destination for cutting-edge insights, news, and analysis in the fields of Artificial Intelligence (AI), Cryptocurrency, Technology, and Startups. At Tech Brunch, we are passionate about exploring the latest trends, innovations, and developments shaping the future of these dynamic industries.

Our Picks

Ring cameras and doorbells now use AI to provide specific descriptions of motion activities

June 25, 2025

Julie Bornstein's Daydream is releasing AI-powered chatbots for fashion-related shopping

June 25, 2025

The $1,200 tequila on the all-in-podcast is already sold out

June 24, 2025

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

© 2025 TechBrunch. Designed by TechBrunch.
  • Home
  • About Tech Brunch
  • Advertise with Tech Brunch
  • Contact us
  • DMCA Notice
  • Privacy Policy
  • Terms of Use

Type above and press Enter to search. Press Esc to cancel.