Close Menu
TechBrunchTechBrunch
  • Home
  • AI
  • Apps
  • Crypto
  • Security
  • Startups
  • TechCrunch
  • Venture

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

What's Hot

72,000 user images have been published in violation of dating safety appetite

July 26, 2025

Allianz Life says “majority” of customer personal data stolen in a cyber attack

July 26, 2025

Index venture “Jahanvisaldana” shares the truth about what TAM and founders should focus on instead

July 25, 2025
Facebook X (Twitter) Instagram
TechBrunchTechBrunch
  • Home
  • AI

    OpenAI seeks to extend human lifespans with the help of longevity startups

    January 17, 2025

    Farewell to the $200 million woolly mammoth and TikTok

    January 17, 2025

    Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

    January 17, 2025

    Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

    January 16, 2025

    Apple suspends AI notification summaries for news after generating false alerts

    January 16, 2025
  • Apps

    Sam Altman warns that ChatGpt is not legally confidential when using it as a therapist

    July 25, 2025

    Apple expands the App Store age rating system

    July 25, 2025

    Google is testing a vibe coding app called Opal

    July 25, 2025

    Use x Community Notes to test and find everyone's favorite posts

    July 24, 2025

    Apple iOS 26 Public Beta Arrival

    July 24, 2025
  • Crypto

    Telegram's Crypto Wallet will be released in the US

    July 22, 2025

    Indian Crypto ExchangeCoindCX confirms $44 million stolen during hack

    July 21, 2025

    North Korean hackers blamed record-breaking spikes in 2025

    July 17, 2025

    Bitcoin surpasses $118K at the second highest high in 24 hours

    July 11, 2025

    Vitalik Buterin reserves for Sam Altman's global project

    June 28, 2025
  • Security

    72,000 user images have been published in violation of dating safety appetite

    July 26, 2025

    Allianz Life says “majority” of customer personal data stolen in a cyber attack

    July 26, 2025

    It took Google a month to shut down Catwatchful, a phone spyware operation hosted on the server

    July 25, 2025

    Cybercrime Forum Leak Zone has published the IP address of the user

    July 24, 2025

    AI Slops and Fake Reports are running out of winnings for some security bugs

    July 24, 2025
  • Startups

    7 days left: Founders and VCs save over $300 on all stage passes

    March 24, 2025

    AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

    March 24, 2025

    20 Hottest Open Source Startups of 2024

    March 22, 2025

    Andrill may build a weapons factory in the UK

    March 21, 2025

    Startup Weekly: Wiz bets paid off at M&A Rich Week

    March 21, 2025
  • TechCrunch

    OpenSea takes a long-term view with a focus on UX despite NFT sales remaining low

    February 8, 2024

    AI will save software companies' growth dreams

    February 8, 2024

    B2B and B2C are not about who buys, but how you sell

    February 5, 2024

    It's time for venture capital to break away from fast fashion

    February 3, 2024

    a16z's Chris Dixon believes it's time to focus on blockchain use cases rather than speculation

    February 2, 2024
  • Venture

    Index venture “Jahanvisaldana” shares the truth about what TAM and founders should focus on instead

    July 25, 2025

    With defense momentum growing, NATO Innovation Fund will update its investment team

    July 25, 2025

    How Y Combinator Food Delivery App Uses Tiktok to Soar in the App Store

    July 24, 2025

    VC Victor Lazarte is leaving the benchmark to launch his own company

    July 24, 2025

    Former Y Combinator, A16Z Experts Hold an Invitation-Only Summit for Founders

    July 23, 2025
TechBrunchTechBrunch

DeepSeek's new AI model appears to be one of the best 'open' challengers yet

TechBrunchBy TechBrunchDecember 26, 20244 Mins Read
Facebook Twitter Pinterest Telegram LinkedIn Tumblr WhatsApp Email
Share
Facebook Twitter LinkedIn Pinterest Telegram Email


A Chinese research institute has created what may be one of the most powerful “open” AI models ever.

The model, called DeepSeek V3, was developed by AI company DeepSeek and released on Wednesday under a permissive license that allows developers to download and modify it for most applications, including commercial ones.

DeepSeek V3 can handle a variety of text-based workloads and tasks from descriptive prompts to coding, translation, writing essays and emails, and more.

According to DeepSeek's internal benchmark tests, DeepSeek V3 outperforms both “openly” available downloadable models and “closed” AI models that are only accessible via API. In some coding contests hosted by programming contest platform Codeforces, DeepSeek has outperformed models such as Meta's Llama 3.1 405B, OpenAI's GPT-4o, and Alibaba's Qwen 2.5 72B.

DeepSeek V3 also outperforms the competition in Aider Polgyglot, a test designed to measure things like whether a model can successfully write new code that integrates with existing code.

DeepSeek-V3!

60 tokens/second (3x faster than V2!)
API compatibility remains the same
Completely open source models and papers
671B MoE Parameters
37B Enabling Parameters
Trained with 14.8T high quality tokens

Outperforms Llama 3.1 405b in almost all benchmarks https://t.co/OiHu17hBSI pic.twitter.com/jVwJU07dqf

— Chubby♨️ (@kimmonismus) December 26, 2024

DeepSeek claims that DeepSeek V3 was trained on a dataset of 14.8 trillion tokens. In data science, tokens are used to represent bits of raw data. 1 million tokens is equivalent to approximately 750,000 words.

It's not just the training set that's huge. The size of DeepSeek V3 is huge, with 685 billion parameters. (A parameter is an internal variable model that is used to make predictions or decisions.) This is approximately 1.6 times the size of Llama 3.1 405B, which has 405 billion parameters.

DeepSeek (a Chinese AI company) is making it look easy today with the open weight release of a frontier-grade LLM trained on a tongue-in-cheek budget (2048 GPUs in 2 months, $6 million).

For reference, this level of functionality is believed to require a cluster of nearly 16,000 GPUs. https://t.co/EW7q2pQ94B

— Andrei Karpathy (@karpathy) December 26, 2024

The number of parameters often (but not always) correlates with skill. Models with more parameters tend to perform better than models with fewer parameters. However, larger models also require more powerful hardware to run. The unoptimized version of DeepSeek V3 requires a set of high-end GPUs to answer questions at reasonable speeds.

DeepSeek V3 isn't the most practical model, but it delivers in several ways. DeepSeek was able to train the model in just about two months using a data center of Nvidia H800 GPUs. This GPU was recently restricted from being procured by Chinese companies by the US Department of Commerce. The company also claims that it spent only $5.5 million training DeepSeek V3, a fraction of the cost of developing models such as OpenAI's GPT-4.

The downside is that the model's political views are a bit filtered. For example, if you ask DeepSeek V3 about Tiananmen Square, it won't give you an answer.

DeepSeek is a Chinese company and is subject to benchmarking by China's internet regulator to ensure that its model responses “embody socialist core values.” Many of China's AI systems refuse to respond to topics that could anger regulators, such as speculation about Xi Jinping's government.

DeepSeek is an interesting organization, having recently announced DeepSeek-R1, an answer to OpenAI's o1 “inference” model. It is backed by Highflyer Capital Management, a Chinese quantitative hedge fund that uses AI to inform trading decisions.

DeepSeek's model has forced competitors such as ByteDance, Baidu, and Alibaba to lower the price of using some models and make others completely free.

High-Flyer has built its own server clusters for model training, the latest of which is powered by 10,000 Nvidia A100 GPUs and costs 1 billion yen (approximately $138 million) It is said that. Founded by computer science graduate Liang Wenfeng, High-Flyer aims to enable “hyperintelligent” AI through its DeepSeek organization.

In an interview earlier this year, Liang described open source as a “cultural act” and characterized closed-source AI like OpenAI as a “temporary” moat. “Even OpenAI's closed-source approach hasn't stopped others from catching up,” he noted.

surely.





Source link

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

OpenAI seeks to extend human lifespans with the help of longevity startups

January 17, 2025

Farewell to the $200 million woolly mammoth and TikTok

January 17, 2025

Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

January 17, 2025

Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

January 16, 2025

Apple suspends AI notification summaries for news after generating false alerts

January 16, 2025

Nvidia releases more tools and guardrails to help enterprises adopt AI agents

January 16, 2025

Leave A Reply Cancel Reply

Top Reviews
Editors Picks

7 days left: Founders and VCs save over $300 on all stage passes

March 24, 2025

AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

March 24, 2025

20 Hottest Open Source Startups of 2024

March 22, 2025

Andrill may build a weapons factory in the UK

March 21, 2025
About Us
About Us

Welcome to Tech Brunch, your go-to destination for cutting-edge insights, news, and analysis in the fields of Artificial Intelligence (AI), Cryptocurrency, Technology, and Startups. At Tech Brunch, we are passionate about exploring the latest trends, innovations, and developments shaping the future of these dynamic industries.

Our Picks

72,000 user images have been published in violation of dating safety appetite

July 26, 2025

Allianz Life says “majority” of customer personal data stolen in a cyber attack

July 26, 2025

Index venture “Jahanvisaldana” shares the truth about what TAM and founders should focus on instead

July 25, 2025

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

© 2025 TechBrunch. Designed by TechBrunch.
  • Home
  • About Tech Brunch
  • Advertise with Tech Brunch
  • Contact us
  • DMCA Notice
  • Privacy Policy
  • Terms of Use

Type above and press Enter to search. Press Esc to cancel.