Close Menu
TechBrunchTechBrunch
  • Home
  • AI
  • Apps
  • Crypto
  • Security
  • Startups
  • TechCrunch
  • Venture

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

What's Hot

Robinhood plans to launch a startup fund that is open to all retail investors

September 15, 2025

9 Most Popular Startups From YC Demo Day

September 15, 2025

Gucci, Balenciaga and other brands own companies checking hacks

September 15, 2025
Facebook X (Twitter) Instagram
TechBrunchTechBrunch
  • Home
  • AI

    OpenAI seeks to extend human lifespans with the help of longevity startups

    January 17, 2025

    Farewell to the $200 million woolly mammoth and TikTok

    January 17, 2025

    Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

    January 17, 2025

    Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

    January 16, 2025

    Apple suspends AI notification summaries for news after generating false alerts

    January 16, 2025
  • Apps

    Google brings Pixel 6 and new devices to Material3 Expressive, along with other features, to the Pixel 6 and new devices

    September 3, 2025

    Google's NoteBookLM now allows you to customize the tone of your AI podcasts

    September 3, 2025

    Roblox expands the use of age estimation techniques and introduces standardized assessments

    September 3, 2025

    Instagram finally launches the iPad app

    September 3, 2025

    Complete the 2025 Confusion Builder Stage Agenda with the Maximum Scaling Voice

    September 3, 2025
  • Crypto

    PayPal will add a new one-to-one payment link to support Crypto soon

    September 15, 2025

    10 additional exhibition tables open and open in 2025

    September 15, 2025

    Stripe will showcase who WHO including Humanity, Openai and Paradigm to build a new blockchain

    September 4, 2025

    Coinbase CEO explains why he fired an engineer who didn't try AI right away

    August 22, 2025

    Your next customer is destroying the 2025 Expo floor

    August 19, 2025
  • Security

    Gucci, Balenciaga and other brands own companies checking hacks

    September 15, 2025

    Israel announces $1.5 million seizure from crypto wallet linked to Iran

    September 15, 2025

    This is Tech Powering that drives the crackdown on Ice's deportation.

    September 13, 2025

    Apple's latest iPhone security features have made life even more difficult for spyware makers

    September 11, 2025

    France says Apple has notified victims of a new spyware attack

    September 11, 2025
  • Startups

    7 days left: Founders and VCs save over $300 on all stage passes

    March 24, 2025

    AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

    March 24, 2025

    20 Hottest Open Source Startups of 2024

    March 22, 2025

    Andrill may build a weapons factory in the UK

    March 21, 2025

    Startup Weekly: Wiz bets paid off at M&A Rich Week

    March 21, 2025
  • TechCrunch

    OpenSea takes a long-term view with a focus on UX despite NFT sales remaining low

    February 8, 2024

    AI will save software companies' growth dreams

    February 8, 2024

    B2B and B2C are not about who buys, but how you sell

    February 5, 2024

    It's time for venture capital to break away from fast fashion

    February 3, 2024

    a16z's Chris Dixon believes it's time to focus on blockchain use cases rather than speculation

    February 2, 2024
  • Venture

    Robinhood plans to launch a startup fund that is open to all retail investors

    September 15, 2025

    9 Most Popular Startups From YC Demo Day

    September 15, 2025

    Do startups still need Silicon Valley? Check out 2025 Surpt

    September 15, 2025

    TechCrunch volunteer time is now in 2025

    September 15, 2025

    Eric Yuan and Santi Subotovsky on the success of breakouts in 2025 destruction

    September 15, 2025
TechBrunchTechBrunch

OpenAI created a team to control a 'super-intelligent' AI, but has since let the AI ​​decline, sources say

TechBrunchBy TechBrunchMay 17, 20243 Mins Read
Facebook Twitter Pinterest Telegram LinkedIn Tumblr WhatsApp Email
Share
Facebook Twitter LinkedIn Pinterest Telegram Email


OpenAI's Superalignment team is responsible for developing ways to manage and operate “super-intelligent” AI systems, and is committed to providing 20% ​​of the company's computing resources, according to team officials. It is said that there is But requests for some of that compute were often denied, hampering the team's work.

The issue, among others, led to the resignation of several team members this week, including co-leader Jan Reich. He is a former DeepMind researcher who worked on ChatGPT, GPT-4, and ChatGPT's predecessor, InstructGPT, during the OpenAI era.

Reich announced the reasons for his resignation Friday morning. “I disagreed with OpenAI's leadership on the company's core priorities for quite some time, but I finally reached a breaking point,” Reich wrote in a series of posts about X. Covers security, surveillance, readiness, safety, adversarial robustness, (hyper)coordination, confidentiality, social impact, and related topics for next-generation models. Solving these problems will be very difficult, and I fear we are not on track to get there. ”

OpenAI did not immediately respond to a request for comment regarding the resources promised and allocated to its team.

OpenAI formed the Superalignment team last July, led by Leike and OpenAI co-founder Ilya Sutskever, who also resigned from the company this week. It had an ambitious goal of solving the core technical challenge of controlling superintelligent AI over the next four years. The team, which includes scientists and engineers from OpenAI's former alignment department and researchers from other organizations within the company, will contribute to research that will inform the safety of both internal and non-OpenAI models. Through initiatives such as our , research grant program , we solicit and share work from the broader AI industry.

The Superalignment team published a series of safety studies and successfully funneled millions of dollars in grants to outside researchers. But as his OpenAI executives' bandwidth began to increase with product launches, the Super Alignment team realized they had to fight for more upfront investment. This investment was considered critical to the company's stated mission to develop super-intelligent AI for the benefit of all people. Human race.

“Building machines that are smarter than humans is an inherently risky endeavor,” Reich continued. “But in recent years, safety culture and processes have taken a backseat to shiny products.”

Sutskever's battle with OpenAI CEO Sam Altman provided an additional distraction.

Sutskever, along with OpenAI's former board of directors, abruptly moved to fire Altman late last year over concerns that he had not been “consistently candid” with board members. Under pressure from OpenAI investors, including Microsoft, and many of the company's employees, Altman was eventually reinstated, much of the board of directors resigned, and Sutskever reportedly never returned to work. .

Sutskever contributed to the Superalignment team, contributing to research as well as acting as a liaison to other departments within OpenAI, according to officials. He was also going to serve as an ambassador of sorts, impressing upon OpenAI's key decision makers the importance of the team's efforts.

Following the departures of Reich and Sutskever, another OpenAI co-founder, John Schulman, was moved to be responsible for the type of work that the superalignment team was doing, but with no dedicated team and a gradual This will be a team that collaborates. A group of researchers belonging to each department within the company. An OpenAI spokesperson described this as an “integration.” [the team] Deeper. ”

The concern is that as a result, OpenAI's AI development will not be as safety-focused as expected.



Source link

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

OpenAI seeks to extend human lifespans with the help of longevity startups

January 17, 2025

Farewell to the $200 million woolly mammoth and TikTok

January 17, 2025

Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

January 17, 2025

Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

January 16, 2025

Apple suspends AI notification summaries for news after generating false alerts

January 16, 2025

Nvidia releases more tools and guardrails to help enterprises adopt AI agents

January 16, 2025

Leave A Reply Cancel Reply

Top Reviews
Editors Picks

7 days left: Founders and VCs save over $300 on all stage passes

March 24, 2025

AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

March 24, 2025

20 Hottest Open Source Startups of 2024

March 22, 2025

Andrill may build a weapons factory in the UK

March 21, 2025
About Us
About Us

Welcome to Tech Brunch, your go-to destination for cutting-edge insights, news, and analysis in the fields of Artificial Intelligence (AI), Cryptocurrency, Technology, and Startups. At Tech Brunch, we are passionate about exploring the latest trends, innovations, and developments shaping the future of these dynamic industries.

Our Picks

Robinhood plans to launch a startup fund that is open to all retail investors

September 15, 2025

9 Most Popular Startups From YC Demo Day

September 15, 2025

Gucci, Balenciaga and other brands own companies checking hacks

September 15, 2025

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

© 2025 TechBrunch. Designed by TechBrunch.
  • Home
  • About Tech Brunch
  • Advertise with Tech Brunch
  • Contact us
  • DMCA Notice
  • Privacy Policy
  • Terms of Use

Type above and press Enter to search. Press Esc to cancel.