Close Menu
TechBrunchTechBrunch
  • Home
  • AI
  • Apps
  • Crypto
  • Security
  • Startups
  • TechCrunch
  • Venture

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

What's Hot

How Y Combinator Food Delivery App Uses Tiktok to Soar in the App Store

July 24, 2025

VC Victor Lazarte is leaving the benchmark to launch his own company

July 24, 2025

Use x Community Notes to test and find everyone's favorite posts

July 24, 2025
Facebook X (Twitter) Instagram
TechBrunchTechBrunch
  • Home
  • AI

    OpenAI seeks to extend human lifespans with the help of longevity startups

    January 17, 2025

    Farewell to the $200 million woolly mammoth and TikTok

    January 17, 2025

    Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

    January 17, 2025

    Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

    January 16, 2025

    Apple suspends AI notification summaries for news after generating false alerts

    January 16, 2025
  • Apps

    Use x Community Notes to test and find everyone's favorite posts

    July 24, 2025

    Apple iOS 26 Public Beta Arrival

    July 24, 2025

    Spotify will swing in the game with a mini golf game before the release of “Happy Gilmore 2”

    July 24, 2025

    Snapchat lets your friends know that you've safely made it home

    July 24, 2025

    Google's new AI features let you try on clothes virtually

    July 24, 2025
  • Crypto

    Telegram's Crypto Wallet will be released in the US

    July 22, 2025

    Indian Crypto ExchangeCoindCX confirms $44 million stolen during hack

    July 21, 2025

    North Korean hackers blamed record-breaking spikes in 2025

    July 17, 2025

    Bitcoin surpasses $118K at the second highest high in 24 hours

    July 11, 2025

    Vitalik Buterin reserves for Sam Altman's global project

    June 28, 2025
  • Security

    Cybercrime Forum Leak Zone has published the IP address of the user

    July 24, 2025

    AI Slops and Fake Reports are running out of winnings for some security bugs

    July 24, 2025

    European authorities arrest administrators of the infamous Russian Crime Forum XSS

    July 23, 2025

    Hundreds of organizations that violated SharePoint Mass-Hacks

    July 23, 2025

    Apple warned Iranians against iPhone spyware attacks, researchers say

    July 22, 2025
  • Startups

    7 days left: Founders and VCs save over $300 on all stage passes

    March 24, 2025

    AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

    March 24, 2025

    20 Hottest Open Source Startups of 2024

    March 22, 2025

    Andrill may build a weapons factory in the UK

    March 21, 2025

    Startup Weekly: Wiz bets paid off at M&A Rich Week

    March 21, 2025
  • TechCrunch

    OpenSea takes a long-term view with a focus on UX despite NFT sales remaining low

    February 8, 2024

    AI will save software companies' growth dreams

    February 8, 2024

    B2B and B2C are not about who buys, but how you sell

    February 5, 2024

    It's time for venture capital to break away from fast fashion

    February 3, 2024

    a16z's Chris Dixon believes it's time to focus on blockchain use cases rather than speculation

    February 2, 2024
  • Venture

    How Y Combinator Food Delivery App Uses Tiktok to Soar in the App Store

    July 24, 2025

    VC Victor Lazarte is leaving the benchmark to launch his own company

    July 24, 2025

    Former Y Combinator, A16Z Experts Hold an Invitation-Only Summit for Founders

    July 23, 2025

    Confuses 2025: First complete agenda reveals in new release phase

    July 23, 2025

    Gupshup raises $60 million in stocks and debt, leaving unicorn status hanging

    July 23, 2025
TechBrunchTechBrunch

AI safety advocates tell founders to slow down

TechBrunchBy TechBrunchNovember 5, 20244 Mins Read
Facebook Twitter Pinterest Telegram LinkedIn Tumblr WhatsApp Email
Share
Facebook Twitter LinkedIn Pinterest Telegram Email


“Move carefully and be on the red team” is unfortunately not as catchy as “move fast and break things.” But three AI safety advocates made it clear to startup founders that moving too quickly could lead to ethical issues in the long run.

“We're at a tipping point where a lot of resources are moving into this space,” said Sarah Myers West, co-executive director of the AI ​​Now Institute, on stage at TechCrunch Disrupt 2024. Rushing to bring certain products into the world without considering the traditional questions of what kind of world we really want to live in and how does the technology being produced serve that world? That's all. or actively causing harm. ”

This conversation comes at a time when the issue of AI safety feels more pressing than ever. In October, the family of a child who died by suicide sued chatbot company Character.AI for its role in the child's death.

“This story illustrates the significant risks posed by the very rapid deployment of AI-based technologies that we have seen,” said Meyers West. “Some of these are long-standing and largely intractable problems with content moderation of online abuse.

But beyond these life-or-death issues, the risks of AI remain high, from misinformation to copyright infringement.

“We're building something that has great power and ability to really, really impact people's lives,” said Jinna Chan, founder of Cara, a social platform for artists. “When you talk about something like Character.AI that engages someone emotionally, it makes sense to me that there should be guardrails in how that product is built.”

Zhang's platform Cara became popular after Meta revealed that any user's public posts can be used to train AI. For artists like Chan himself, this policy is a slap in the face. Artists need to post their work online to gain followers and secure potential clients, but in doing so, their work may be exposed to the very AI that could one day cost them their jobs. May be used to form models.

“Copyright protects us and allows us to earn a living,” Zhang said. Even if the artwork is available online, that doesn't mean it's free, per se. For example, digital news publications must obtain a license from a photographer to use an image. “As generative AI starts to become more mainstream, what we’re seeing is that it doesn’t work with what we’re normally used to, which is established in law. If they want to use our work, they have to get a license.”

Aleksandra Pedraszewska at TechCrunch Disrupt 2024 on Wednesday, October 30, 2024 AI Safety Eleven Labs, Sarah Myers West Executive Director AI Now Institute, Jingna Zhang Founder and CEO Cara (Photo by Katelyn Tucker/Slava Blade Photography)Aleksandra Pedraszewska, AI Safety, Eleven Labs, AI Now Institute Executive Director Sarah Myers West. Cara founder and CEO Jingna Zhang spoke at TechCrunch Disrupt 2024 on Wednesday, October 30, 2024. Image credit: Katelyn Tucker/Slava Blade Photography

Artists could also be influenced by products like Eleven Labs, an AI voice cloning company with a market capitalization of more than $1 billion. Aleksandra Pedraszewska, head of safety at Eleven Labs, is responsible for ensuring that the company's advanced technology is not used for things like non-consensual deepfakes.

“I think the unintended consequences of red team models, understanding undesirable behaviors, and the launch of new generative AI companies are becoming important again. [a top priority]” she said. “Eleven Labs currently has 33 million users, which is a large community that is affected by every change we make to the product.”

Pedraszewska said one way people in her role can be more proactive in keeping the platform safe is by building closer relationships with the user community.

“We cannot operate between two extremes: completely anti-AI and anti-GenAI. One is completely anti-AI and anti-GenAI, and the other is effectively persuading zero space regulation. “When it comes to regulation, I think we need to meet in the middle,” she said.

TechCrunch has a newsletter focused on AI. Sign up here to get it delivered to your inbox every Wednesday.



Source link

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

OpenAI seeks to extend human lifespans with the help of longevity startups

January 17, 2025

Farewell to the $200 million woolly mammoth and TikTok

January 17, 2025

Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

January 17, 2025

Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

January 16, 2025

Apple suspends AI notification summaries for news after generating false alerts

January 16, 2025

Nvidia releases more tools and guardrails to help enterprises adopt AI agents

January 16, 2025

Leave A Reply Cancel Reply

Top Reviews
Editors Picks

7 days left: Founders and VCs save over $300 on all stage passes

March 24, 2025

AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

March 24, 2025

20 Hottest Open Source Startups of 2024

March 22, 2025

Andrill may build a weapons factory in the UK

March 21, 2025
About Us
About Us

Welcome to Tech Brunch, your go-to destination for cutting-edge insights, news, and analysis in the fields of Artificial Intelligence (AI), Cryptocurrency, Technology, and Startups. At Tech Brunch, we are passionate about exploring the latest trends, innovations, and developments shaping the future of these dynamic industries.

Our Picks

How Y Combinator Food Delivery App Uses Tiktok to Soar in the App Store

July 24, 2025

VC Victor Lazarte is leaving the benchmark to launch his own company

July 24, 2025

Use x Community Notes to test and find everyone's favorite posts

July 24, 2025

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

© 2025 TechBrunch. Designed by TechBrunch.
  • Home
  • About Tech Brunch
  • Advertise with Tech Brunch
  • Contact us
  • DMCA Notice
  • Privacy Policy
  • Terms of Use

Type above and press Enter to search. Press Esc to cancel.