Close Menu
TechBrunchTechBrunch
  • Home
  • AI
  • Apps
  • Crypto
  • Security
  • Startups
  • TechCrunch
  • Venture

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

What's Hot

The founders of Digg explain how they are building sites for humans in the age of AI

June 2, 2025

Elon Musk's Neuralink closes the $650 million series

June 2, 2025

Finally, the $25 billion worth of chimes aims to reach $11 billion in future IPOs

June 2, 2025
Facebook X (Twitter) Instagram
TechBrunchTechBrunch
  • Home
  • AI

    OpenAI seeks to extend human lifespans with the help of longevity startups

    January 17, 2025

    Farewell to the $200 million woolly mammoth and TikTok

    January 17, 2025

    Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

    January 17, 2025

    Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

    January 16, 2025

    Apple suspends AI notification summaries for news after generating false alerts

    January 16, 2025
  • Apps

    The founders of Digg explain how they are building sites for humans in the age of AI

    June 2, 2025

    Elon Musk says Xchat is rolling out to everything, but questions remain about its suspected security

    June 2, 2025

    Google quietly released an app that allows you to download and run AI models locally

    May 31, 2025

    A guide to using editing, Meta's new Capcut Rival for Short-Form video editing

    May 31, 2025

    Automattic says it will start contributing to WordPress again after pause

    May 30, 2025
  • Crypto

    GameStop bought $500 million in Bitcoin

    May 28, 2025

    Vote for the session you want to watch in 2025

    May 26, 2025

    Save $900 + 90% from 2 tickets to destroy 2025 in the last 24 hours

    May 25, 2025

    Only 3 days left to save up to $900 to destroy the 2025 pass

    May 23, 2025

    Starting from up to $900 from Ticep, 90% off +1 in 2025

    May 22, 2025
  • Security

    Vanta Bug has made its customer data public to other customers

    June 2, 2025

    NSO Group calls the judge for a new trial, calling $167 million in damages “outrageous”

    June 2, 2025

    8 things we learned from WhatsApp vs. NSO Group Spyware Litigation

    May 30, 2025

    White House investigates how Trump's chief staff's phone was hacked

    May 30, 2025

    US government sanctions technology company involved in cyber fraud

    May 29, 2025
  • Startups

    7 days left: Founders and VCs save over $300 on all stage passes

    March 24, 2025

    AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

    March 24, 2025

    20 Hottest Open Source Startups of 2024

    March 22, 2025

    Andrill may build a weapons factory in the UK

    March 21, 2025

    Startup Weekly: Wiz bets paid off at M&A Rich Week

    March 21, 2025
  • TechCrunch

    OpenSea takes a long-term view with a focus on UX despite NFT sales remaining low

    February 8, 2024

    AI will save software companies' growth dreams

    February 8, 2024

    B2B and B2C are not about who buys, but how you sell

    February 5, 2024

    It's time for venture capital to break away from fast fashion

    February 3, 2024

    a16z's Chris Dixon believes it's time to focus on blockchain use cases rather than speculation

    February 2, 2024
  • Venture

    Elon Musk's Neuralink closes the $650 million series

    June 2, 2025

    Finally, the $25 billion worth of chimes aims to reach $11 billion in future IPOs

    June 2, 2025

    Elon Musk's Xai is reportedly seeking a $300 million tender offer

    June 2, 2025

    Request Exhibitor Tables for TC All Stages for 5 days remaining | TechCrunch

    June 2, 2025

    TC Session: AI Trivi Account Down – Earn big tickets

    June 2, 2025
TechBrunchTechBrunch

This German nonprofit is building an open voice assistant that anyone can use

TechBrunchBy TechBrunchFebruary 15, 20246 Mins Read
Facebook Twitter Pinterest Telegram LinkedIn Tumblr WhatsApp Email
Share
Facebook Twitter LinkedIn Pinterest Telegram Email


There have been many attempts at open-source AI-powered voice assistants (see Rhasspy, Mycroft, and Jasper to name a few), all of which have focused on privacy without compromising functionality. Established with the goal of creating a protected offline experience. However, development has proven to be very slow. That's because, in addition to the usual challenges associated with open source projects, programming the assistant is extremely difficult. difficult. Technologies like Google Assistant, Siri, and Alexa have years, if not decades, of research and development and huge infrastructures to boot.

But that doesn't deter the people at Large-Scale Artificial Intelligence Open Network (LAION), the German nonprofit responsible for maintaining the world's most popular AI training data set. This month, LAION announced his BUD-E, a new initiative that aims to build a “fully open” voice assistant that can run on consumer hardware.

Why launch an entirely new voice assistant project when there are countless abandoned voice assistants in various states? Wieland Brendel, Ellis Institute fellow and BUD-E contributor, We believe that no open assistant exists with an architecture that is extensible enough to take full advantage of GenAI technology, especially large-scale language models (LLMs). OpenAI's ChatGPT.

“Most interactions are [assistants] Relies on a chat interface that is quite tedious to interact with [and] Interacting with these systems feels stilted and unnatural,” Brendel told TechCrunch in an email interview. “These systems are fine for communicating commands to control music or turn on lights, but they don't provide the basis for long, engaging conversations. BUD-E's goal is to The goal is to provide the basis for a voice assistant that feels natural, mimics the natural speech patterns of human interaction, and remembers past conversations.”

Brendel added that LAION wants all components of BUD-E to eventually be able to integrate with apps and services, even commercially, license-free. This is not necessarily the case with other open assistant initiatives.

BUD-E (recursive abbreviation for “Friends for Understanding and Digital Empathy”), a collaboration between the Ellis Institute in Tübingen, the technology consultancy Collabora and the Tübingen AI Center, has an ambitious roadmap. In a blog post, the LAION team revealed what they hope to accomplish in the coming months, primarily building “emotional intelligence” into BUD-E and ensuring conversations involving multiple speakers simultaneously. It is to be able to process it.

“There's a huge need for natural voice assistants that work well,” Brendel said. “LAION has shown in the past that it excels at community building, and ELLIS Institute Tübingen and Tübingen AI Center are committed to providing resources to develop the assistant. ”

BUD-E is up and running. You can download and install it now from GitHub on Ubuntu or Windows PC (macOS is coming). But it is clear that we are still in the early stages.

LAION assembled the MVP by stitching together several open models, including Microsoft's Phi-2 LLM, Columbia's StyleTTS2 for speech synthesis, and Nvidia's FastConformer for speech synthesis. So the experience is a little less optimized. For BUD-E to respond to commands within about 500 milliseconds, within the range of commercial voice assistants like Google Assistant and Alexa, a powerful GPU like Nvidia's is required. RTX4090.

Collabora is working pro bono to adapt its open source speech recognition and text-to-speech models, WhisperLive and WhisperSpeech, to BUD-E.

Jakub Piotr Cłapa, AI researcher and BUD-E team member at Collabora, said: “Building text-to-speech and speech recognition solutions ourselves is not possible with a closed model exposed through an API. That means it can be customized to a certain extent,” he said in an email. “The collaboration was initially [open assistants] One reason for this was that we had difficulty finding a suitable text-to-speech solution for an LLM-based voice agent for one of our customers. We decided to collaborate with the broader open source community to make our model more widely accessible and useful. ”

Near future, According to LAION, this will reduce the burden on BUD-E's hardware requirements and reduce wait times for the assistant. A longer-term effort is to build a data set of dialogs to fine-tune BUD-E. It is also possible to build a memory mechanism that allows BUD-E to store information from previous conversations, as well as an audio processing pipeline that allows it to track conversations between multiple people. immediately.

I asked the team: accessibility This was a priority, given that speech recognition systems have historically not worked well with languages ​​other than English or accents other than Transatlantic languages. A Stanford University study found that speech recognition systems from Amazon, IBM, Google, Microsoft, and Apple were almost twice as likely to mishear a black speaker as they were a black speaker of the same age and gender. I understand that.

Brendel said: LAION doesn't ignore accessibility — but that's not the “immediate focus” BUD-E.

“The initial focus is to really redefine the experience of how you interact with voice assistants before generalizing that experience to a wider variety of accents and languages,” Brendel said.

for that, LAION has some pretty wild ideas for BUD-E, from an animated avatar to anthropomorphize the assistant to support for analyzing the user's face via webcam to describe emotional states.

That last bit, the ethics of facial analysis, is, needless to say, a little dicey. However, LAION co-founder Robert Kaczmarczyk emphasized that LAION remains committed to safety.

“[We] “Strictly adhere to the safety and ethical guidelines established by the EU AI Law,” he told TechCrunch via email, referring to the legal framework governing the sale and use of AI in the EU. The EU AI law allows European Union member states to adopt more restrictive rules and safeguards for “high-risk” AI, including emotion classifiers.

““This commitment to transparency not only facilitates the early detection and correction of potential biases, but also serves the cause of scientific integrity,” Kaczmarczyk added. “By providing access to our datasets, we enable the broader scientific community to participate in research that maintains the highest standards of reproducibility.”

LAION's previous work has not been ethically pure, and he is currently working on another somewhat controversial project in emotion detection. But perhaps her BUD-E will be different. We'll have to wait and see.



Source link

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

OpenAI seeks to extend human lifespans with the help of longevity startups

January 17, 2025

Farewell to the $200 million woolly mammoth and TikTok

January 17, 2025

Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

January 17, 2025

Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

January 16, 2025

Apple suspends AI notification summaries for news after generating false alerts

January 16, 2025

Nvidia releases more tools and guardrails to help enterprises adopt AI agents

January 16, 2025

Leave A Reply Cancel Reply

Top Reviews
Editors Picks

7 days left: Founders and VCs save over $300 on all stage passes

March 24, 2025

AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

March 24, 2025

20 Hottest Open Source Startups of 2024

March 22, 2025

Andrill may build a weapons factory in the UK

March 21, 2025
About Us
About Us

Welcome to Tech Brunch, your go-to destination for cutting-edge insights, news, and analysis in the fields of Artificial Intelligence (AI), Cryptocurrency, Technology, and Startups. At Tech Brunch, we are passionate about exploring the latest trends, innovations, and developments shaping the future of these dynamic industries.

Our Picks

The founders of Digg explain how they are building sites for humans in the age of AI

June 2, 2025

Elon Musk's Neuralink closes the $650 million series

June 2, 2025

Finally, the $25 billion worth of chimes aims to reach $11 billion in future IPOs

June 2, 2025

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

© 2025 TechBrunch. Designed by TechBrunch.
  • Home
  • About Tech Brunch
  • Advertise with Tech Brunch
  • Contact us
  • DMCA Notice
  • Privacy Policy
  • Terms of Use

Type above and press Enter to search. Press Esc to cancel.