Close Menu
TechBrunchTechBrunch
  • Home
  • AI
  • Apps
  • Crypto
  • Security
  • Startups
  • TechCrunch
  • Venture

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

What's Hot

Want to know where the VC will invest next? See 2025 suspension

September 9, 2025

Plex urges users to change their password after a data breach

September 9, 2025

Netskope tracks Rubrik as a rare cybersecurity IPO, both backed by Lightspeed

September 8, 2025
Facebook X (Twitter) Instagram
TechBrunchTechBrunch
  • Home
  • AI

    OpenAI seeks to extend human lifespans with the help of longevity startups

    January 17, 2025

    Farewell to the $200 million woolly mammoth and TikTok

    January 17, 2025

    Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

    January 17, 2025

    Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

    January 16, 2025

    Apple suspends AI notification summaries for news after generating false alerts

    January 16, 2025
  • Apps

    Google brings Pixel 6 and new devices to Material3 Expressive, along with other features, to the Pixel 6 and new devices

    September 3, 2025

    Google's NoteBookLM now allows you to customize the tone of your AI podcasts

    September 3, 2025

    Roblox expands the use of age estimation techniques and introduces standardized assessments

    September 3, 2025

    Instagram finally launches the iPad app

    September 3, 2025

    Complete the 2025 Confusion Builder Stage Agenda with the Maximum Scaling Voice

    September 3, 2025
  • Crypto

    Stripe will showcase who WHO including Humanity, Openai and Paradigm to build a new blockchain

    September 4, 2025

    Coinbase CEO explains why he fired an engineer who didn't try AI right away

    August 22, 2025

    Your next customer is destroying the 2025 Expo floor

    August 19, 2025

    Crypto Company Gemini File for Winklevoss Twins IPO

    August 16, 2025

    North Korean spies pretending to be remote workers have invaded hundreds of businesses, CloudStrike says

    August 4, 2025
  • Security

    Plex urges users to change their password after a data breach

    September 9, 2025

    Netskope tracks Rubrik as a rare cybersecurity IPO, both backed by Lightspeed

    September 8, 2025

    VC Giant Insight Partners notifies staff and limited partners after data breach

    September 8, 2025

    Signal introduces free and paid backup plans for your chat

    September 8, 2025

    SalesLoft says theft of drift customer data linked to March GitHub account hack

    September 8, 2025
  • Startups

    7 days left: Founders and VCs save over $300 on all stage passes

    March 24, 2025

    AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

    March 24, 2025

    20 Hottest Open Source Startups of 2024

    March 22, 2025

    Andrill may build a weapons factory in the UK

    March 21, 2025

    Startup Weekly: Wiz bets paid off at M&A Rich Week

    March 21, 2025
  • TechCrunch

    OpenSea takes a long-term view with a focus on UX despite NFT sales remaining low

    February 8, 2024

    AI will save software companies' growth dreams

    February 8, 2024

    B2B and B2C are not about who buys, but how you sell

    February 5, 2024

    It's time for venture capital to break away from fast fashion

    February 3, 2024

    a16z's Chris Dixon believes it's time to focus on blockchain use cases rather than speculation

    February 2, 2024
  • Venture

    Want to know where the VC will invest next? See 2025 suspension

    September 9, 2025

    Edo Liberty explores missed links for Enterprise AI in 2025

    September 8, 2025

    Databricks confirms valuation of $4 billion new $100 million

    September 8, 2025

    Y Combinator Assistance Motion raises fresh $38 million to build an AI agent Microsoft Office

    September 8, 2025

    Get behind the scenes in 2025 with volunteer activities

    September 8, 2025
TechBrunchTechBrunch

Google uses Anthropic's Claude to improve Gemini AI

TechBrunchBy TechBrunchDecember 24, 20243 Mins Read
Facebook Twitter Pinterest Telegram LinkedIn Tumblr WhatsApp Email
Share
Facebook Twitter LinkedIn Pinterest Telegram Email


Contractors working on improving Google's Gemini AI are comparing its answers to the output produced by Anthropic's competing model, Claude, according to internal communications seen by TechCrunch.

When asked for comment by TechCrunch, Google declined to say whether it had permission to use Claude in its tests against Gemini.

As technology companies compete to build better AI models, the performance of these models is often measured against their competitors, typically by having contractors carefully evaluate their competitors' AI responses. rather than by running proprietary models through industry benchmarks.

Contractors working on Gemini, tasked with evaluating the accuracy of the model's output, must score each response they see according to multiple criteria, such as veracity and redundancy. According to communications seen by TechCrunch, contractors will be given up to 30 minutes for each prompt to determine whether Gemini or Claude's answer is better.

Contractors recently began noticing references to Anthropic's Claude appearing on the internal Google platform they use to compare Gemini to other unnamed AI models, the correspondence shows. Masu. At least one of the deliverables submitted to Gemini's contractors clearly stated, “I am Claude, created by Anthropic,” as seen by TechCrunch.

One internal chat showed contractors noticing that Claude's responses seemed to be more safety-oriented than Gemini's. One contractor wrote that “Claude's safety settings are the most stringent” of the AI ​​models. In some cases, Claude did not respond to prompts that were deemed unsafe, such as role-playing another AI assistant. In another article, Claude avoided answering the question, but Gemini's answer included “nudity and bondage” and was flagged for a “serious safety violation.”

Anthropic's commercial terms of service prohibit customers from accessing Claude to “build competitive products or services” or “train competitive AI models” without Anthropic's approval. Google is a major investor in Anthropic.

Sheila McNamara, a spokesperson for Google DeepMind, which operates Gemini, declined to say in response to TechCrunch's questions whether Google had Anthropic's approval to access Claude. An Anthropic spokesperson contacted before publication did not comment by press time.

McNamara said DeepMind will “compare model outputs” for evaluation purposes, but will not train Gemini based on human models.

“Of course, in accordance with standard industry practice, in some cases we will compare model outputs as part of the evaluation process,” McNamara said. “However, the suggestion that a human model was used to train Gemini is inaccurate.”

Last week, TechCrunch exclusively reported that Google contractors working on the company's AI products were being forced to evaluate Gemini's AI capabilities in areas outside of their expertise. In internal communications, contractors expressed concerns that Gemini could generate inaccurate information on highly sensitive topics such as healthcare.

You can securely submit tips to this reporter on Signal (+1 628-282-2811).

TechCrunch has a newsletter focused on AI. Sign up here to get it delivered to your inbox every Wednesday.



Source link

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

OpenAI seeks to extend human lifespans with the help of longevity startups

January 17, 2025

Farewell to the $200 million woolly mammoth and TikTok

January 17, 2025

Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

January 17, 2025

Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

January 16, 2025

Apple suspends AI notification summaries for news after generating false alerts

January 16, 2025

Nvidia releases more tools and guardrails to help enterprises adopt AI agents

January 16, 2025

Leave A Reply Cancel Reply

Top Reviews
Editors Picks

7 days left: Founders and VCs save over $300 on all stage passes

March 24, 2025

AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

March 24, 2025

20 Hottest Open Source Startups of 2024

March 22, 2025

Andrill may build a weapons factory in the UK

March 21, 2025
About Us
About Us

Welcome to Tech Brunch, your go-to destination for cutting-edge insights, news, and analysis in the fields of Artificial Intelligence (AI), Cryptocurrency, Technology, and Startups. At Tech Brunch, we are passionate about exploring the latest trends, innovations, and developments shaping the future of these dynamic industries.

Our Picks

Want to know where the VC will invest next? See 2025 suspension

September 9, 2025

Plex urges users to change their password after a data breach

September 9, 2025

Netskope tracks Rubrik as a rare cybersecurity IPO, both backed by Lightspeed

September 8, 2025

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

© 2025 TechBrunch. Designed by TechBrunch.
  • Home
  • About Tech Brunch
  • Advertise with Tech Brunch
  • Contact us
  • DMCA Notice
  • Privacy Policy
  • Terms of Use

Type above and press Enter to search. Press Esc to cancel.