Close Menu
TechBrunchTechBrunch
  • Home
  • AI
  • Apps
  • Crypto
  • Security
  • Startups
  • TechCrunch
  • Venture

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

What's Hot

Klarna CEO and Sutter Hill wins lap after Jony Ive's Openai deal

May 22, 2025

Bluesky begins to check for “notable” users

May 22, 2025

Microsoft says Lumma Password Stealer Malware found on 394,000 Windows PCs

May 22, 2025
Facebook X (Twitter) Instagram
TechBrunchTechBrunch
  • Home
  • AI

    OpenAI seeks to extend human lifespans with the help of longevity startups

    January 17, 2025

    Farewell to the $200 million woolly mammoth and TikTok

    January 17, 2025

    Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

    January 17, 2025

    Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

    January 16, 2025

    Apple suspends AI notification summaries for news after generating false alerts

    January 16, 2025
  • Apps

    Bluesky begins to check for “notable” users

    May 22, 2025

    Mozilla shuts down its Read-It-Later app pocket

    May 22, 2025

    Opening a Social Web Browser Surf makes it easy for anyone to create custom feeds

    May 22, 2025

    Anthropic's new Claude4 AI model can be inferred in many steps

    May 22, 2025

    Strava buys athletic training app – First Runna, and now Breakaway

    May 22, 2025
  • Crypto

    Starting from up to $900 from Ticep, 90% off +1 in 2025

    May 22, 2025

    Early savings for 2025 will end on May 25th

    May 21, 2025

    Coinbase says its data breach will affect at least 69,000 customers

    May 21, 2025

    There are 6 days to save $900 to destroy 2025 tickets

    May 20, 2025

    Save $900 to destroy 2025 tickets before prices rise on May 25th

    May 19, 2025
  • Security

    Microsoft says Lumma Password Stealer Malware found on 394,000 Windows PCs

    May 22, 2025

    Signal's new Windows update prevents the system from capturing screenshots of chat

    May 22, 2025

    Wyden: AT&T, T-Mobile and Verizon did not inform senators of surveillance requests

    May 21, 2025

    US students agree to plead guilty to hacking affecting tens of millions of students

    May 21, 2025

    The people in Elon Musk’s DOGE universe

    May 20, 2025
  • Startups

    7 days left: Founders and VCs save over $300 on all stage passes

    March 24, 2025

    AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

    March 24, 2025

    20 Hottest Open Source Startups of 2024

    March 22, 2025

    Andrill may build a weapons factory in the UK

    March 21, 2025

    Startup Weekly: Wiz bets paid off at M&A Rich Week

    March 21, 2025
  • TechCrunch

    OpenSea takes a long-term view with a focus on UX despite NFT sales remaining low

    February 8, 2024

    AI will save software companies' growth dreams

    February 8, 2024

    B2B and B2C are not about who buys, but how you sell

    February 5, 2024

    It's time for venture capital to break away from fast fashion

    February 3, 2024

    a16z's Chris Dixon believes it's time to focus on blockchain use cases rather than speculation

    February 2, 2024
  • Venture

    Klarna CEO and Sutter Hill wins lap after Jony Ive's Openai deal

    May 22, 2025

    Wild story of how Moxxie-led Intestinal Toilet Startup Sloan was registered as a gut toilet startup throne

    May 22, 2025

    Submitted submission raises $17 million to automate tax preparation dr voyages

    May 21, 2025

    In a busy VC landscape, Elizabeth Weil's graffiti venture shows that networks are still important

    May 21, 2025

    A comprehensive list of 2025 tech layoffs

    May 21, 2025
TechBrunchTechBrunch

OpenAI's AI inference models sometimes “think” in Chinese, but no one knows why

TechBrunchBy TechBrunchJanuary 14, 20255 Mins Read
Facebook Twitter Pinterest Telegram LinkedIn Tumblr WhatsApp Email
Share
Facebook Twitter LinkedIn Pinterest Telegram Email


Shortly after OpenAI released its first “inference” AI model, o1, people started noticing strange phenomena. Models sometimes started “thinking” in Chinese, Farsi, or other languages ​​even when asked questions in English.

When given a problem to sort out, such as “How many R's are there in the word 'strawberry'?”, o1 begins a “thinking” process and performs a series of reasoning steps to arrive at the answer. If the question is written in English, o1's final response will be in English. However, the model performs several steps in another language before making a conclusion.

“[O1] Halfway through, I randomly started thinking in Chinese,” one Reddit user said.

“Why did it happen? [o1] Do you randomly start thinking in Chinese? another user asked in a post to X. “Some of the conversations (more than 5 messages) were not in Chinese.”

Why did o1 professionals start thinking in Chinese? Some of the conversations (more than 5 messages) were not in Chinese… It was very interesting… Impact of training data pic.twitter.com/yZWCzoaiit

— Rishab Jain (@RishabJainK) January 9, 2025

OpenAI has not explained or acknowledged o1's strange behavior. So what's going on?

Well, AI experts aren't so sure. But they have some theories.

Several people at X, including Hugging Face CEO Clément Delangue, have alluded to the fact that inference models like o1 are trained on datasets containing large amounts of kanji. Ted Xiao, a researcher at Google DeepMind, said that companies including OpenAI use third-party Chinese data labeling services, and that o1's switch to Chinese was due to “Chinese linguistic impact on inference.” claimed to be an example of.

“[Labs like] Utilizing OpenAI and Anthropic [third-party] “Data labeling service for doctoral-level inference data in science, mathematics, and coding,” Xiao wrote in a post on X.[F]Many of these data providers are based in China due to availability of expert resources and cost reasons. ”

Labels, also known as tags or annotations, help models understand and interpret data during the training process. For example, labels for training image recognition models may take the form of markings around objects or captions that refer to each person, place, or object depicted in the image.

Research has shown that biased labels can produce biased models. For example, the average annotator is more likely to label phrases in African American Vernacular English (AAVE), an informal grammar used by some Black Americans, as toxic, and Leading AI toxicity detectors consider AAVE to be disproportionately toxic.

However, other experts do not support the o1 China data labeling hypothesis. They point out that o1 is just as likely to switch to a language other than Hindi, Thai or Chinese while searching for a solution.

Rather, these experts say, o1 and other models of reasoning may simply be using the language that seems most efficient to accomplish their goals (or illusions).

“The model doesn't know what the language is or that it's different,” Matthew Guzdial, an AI researcher and assistant professor at the University of Alberta, told TechCrunch. “It's all just text.”

In fact, the model does not process words directly. Use tokens instead. The token can be a word like “awesome.” Or it can be a syllable, such as “fan,” “tas,” or “tic.” Or it can be an individual letter within a word, such as 'f', 'a', 'n', 't', 'a', 's', 't', 'i', 'c' .

As with labeling, tokens can introduce bias. For example, many word-to-token translators assume that spaces in a sentence represent new words, even though not all languages ​​use spaces to separate words.

Tiezhen Wang, a software engineer at AI startup Hugging Face, agrees with Guzdial that language discrepancies in inference models could be explained by the associations the models made during training.

“By embracing all linguistic nuances, we expand the model's worldview and allow it to learn from the full range of human knowledge,” Wang wrote in a post on X. “For example, I prefer to do math in Chinese because each digit is just one number.” Using syllables makes calculations crisp and efficient. But when it comes to topics like unconscious bias, I automatically switch to English. This is mainly because I learned and absorbed those ideas for the first time in English. ”

Wang's theory is plausible. After all, models are probabilistic machines. Trained on many examples, they learn patterns to make predictions, such as how “to whom” in an email is typically placed before “may be of concern” .

But Luca Soldaini, a researcher at the nonprofit Allen Institute for AI, cautions that we don't know for sure. “These models are so opaque that it's impossible to back up these kinds of observations about deployed AI systems,” he told TechCrunch. “This is one of many examples of why transparency in how AI systems are built is important.”

The lack of answers from OpenAI leaves us wondering why o1 thinks of songs in French but synthetic biology in Chinese.





Source link

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

OpenAI seeks to extend human lifespans with the help of longevity startups

January 17, 2025

Farewell to the $200 million woolly mammoth and TikTok

January 17, 2025

Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

January 17, 2025

Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

January 16, 2025

Apple suspends AI notification summaries for news after generating false alerts

January 16, 2025

Nvidia releases more tools and guardrails to help enterprises adopt AI agents

January 16, 2025

Leave A Reply Cancel Reply

Top Reviews
Editors Picks

7 days left: Founders and VCs save over $300 on all stage passes

March 24, 2025

AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

March 24, 2025

20 Hottest Open Source Startups of 2024

March 22, 2025

Andrill may build a weapons factory in the UK

March 21, 2025
About Us
About Us

Welcome to Tech Brunch, your go-to destination for cutting-edge insights, news, and analysis in the fields of Artificial Intelligence (AI), Cryptocurrency, Technology, and Startups. At Tech Brunch, we are passionate about exploring the latest trends, innovations, and developments shaping the future of these dynamic industries.

Our Picks

Klarna CEO and Sutter Hill wins lap after Jony Ive's Openai deal

May 22, 2025

Bluesky begins to check for “notable” users

May 22, 2025

Microsoft says Lumma Password Stealer Malware found on 394,000 Windows PCs

May 22, 2025

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

© 2025 TechBrunch. Designed by TechBrunch.
  • Home
  • About Tech Brunch
  • Advertise with Tech Brunch
  • Contact us
  • DMCA Notice
  • Privacy Policy
  • Terms of Use

Type above and press Enter to search. Press Esc to cancel.