Close Menu
TechBrunchTechBrunch
  • Home
  • AI
  • Apps
  • Crypto
  • Security
  • Startups
  • TechCrunch
  • Venture

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

What's Hot

WWDC 2025: What to expect from this year's meeting

June 7, 2025

After data is wiped out, Kiranapro co-founders cannot rule out external hacks

June 7, 2025

Why investing in a growing AI startup is risky and more complicated

June 6, 2025
Facebook X (Twitter) Instagram
TechBrunchTechBrunch
  • Home
  • AI

    OpenAI seeks to extend human lifespans with the help of longevity startups

    January 17, 2025

    Farewell to the $200 million woolly mammoth and TikTok

    January 17, 2025

    Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

    January 17, 2025

    Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

    January 16, 2025

    Apple suspends AI notification summaries for news after generating false alerts

    January 16, 2025
  • Apps

    WWDC 2025: What to expect from this year's meeting

    June 7, 2025

    Trump Mask feud was perfect for X and jumped on the app store chart

    June 6, 2025

    iOS 19: All the rumor changes that Apple could bring to the new operating system

    June 6, 2025

    WWDC 2025: What to expect from this year's meeting

    June 6, 2025

    The court denied requests to suspend awards regarding Apple's App Store payment fees

    June 6, 2025
  • Crypto

    xNotify Polymarket as partner in the official forecast market

    June 6, 2025

    Circle IPOs are giving hope to more startups waiting to be published to more startups

    June 5, 2025

    GameStop bought $500 million in Bitcoin

    May 28, 2025

    Vote for the session you want to watch in 2025

    May 26, 2025

    Save $900 + 90% from 2 tickets to destroy 2025 in the last 24 hours

    May 25, 2025
  • Security

    After data is wiped out, Kiranapro co-founders cannot rule out external hacks

    June 7, 2025

    Humanity appoints national security experts to governing trusts

    June 6, 2025

    Italian lawmakers say Italy used spyware to target immigrant activists' mobile phones, but not for journalists

    June 6, 2025

    Humanity unveils custom AI models for US national security customers

    June 5, 2025

    Unlock phone company Cellebrite to acquire mobile testing startup Corellium for $170 million

    June 5, 2025
  • Startups

    7 days left: Founders and VCs save over $300 on all stage passes

    March 24, 2025

    AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

    March 24, 2025

    20 Hottest Open Source Startups of 2024

    March 22, 2025

    Andrill may build a weapons factory in the UK

    March 21, 2025

    Startup Weekly: Wiz bets paid off at M&A Rich Week

    March 21, 2025
  • TechCrunch

    OpenSea takes a long-term view with a focus on UX despite NFT sales remaining low

    February 8, 2024

    AI will save software companies' growth dreams

    February 8, 2024

    B2B and B2C are not about who buys, but how you sell

    February 5, 2024

    It's time for venture capital to break away from fast fashion

    February 3, 2024

    a16z's Chris Dixon believes it's time to focus on blockchain use cases rather than speculation

    February 2, 2024
  • Venture

    Why investing in a growing AI startup is risky and more complicated

    June 6, 2025

    Startup Battlefield 200: Only 3 days left

    June 6, 2025

    Book all TC Stage Exhibitor Tables before ending today

    June 6, 2025

    Less than 48 hours left until display at TC at all stages

    June 5, 2025

    TC Session: AI will be on sale today at Berkeley

    June 5, 2025
TechBrunchTechBrunch

Viggle creates controllable AI characters for visualizing memes and ideas

TechBrunchBy TechBrunchAugust 26, 20245 Mins Read
Facebook Twitter Pinterest Telegram LinkedIn Tumblr WhatsApp Email
Share
Facebook Twitter LinkedIn Pinterest Telegram Email


You may not know Viggle AI, but you've probably seen the viral memes it's created. The Canadian AI startup has made dozens of remix videos of rapper Lil Yachty bopping around onstage at summer music festivals. In one, Lil Yachty is replaced by Joaquin Phoenix's Joker. In another, Jesus appears to be pumping up the crowd. Users created countless versions of the video, but it was one AI startup that made the meme go viral. Viggle's CEO says YouTube videos power the company's AI model.

Viggle trained its 3D video foundation model, JST-1, to have a “true understanding of physics,” as the company claims in a press release. Viggle CEO Hang Chu says the main difference between Viggle and other AI video models is that Viggle allows users to specify the movements they want their characters to make. While other AI video models often create unrealistic character movements that don't follow the laws of physics, Chu claims Viggle's model is different.

“We're essentially building a new type of graphics engine that uses only neural networks,” Chu said in an interview. “The model itself is quite different from existing video generators, which are primarily pixel-based and don't have much understanding of physical structures or properties. Our model is designed to have that understanding, which gives us much more control and efficiency in generation.”

For example, to create a video of the Joker impersonating Lil Yachty, all you need to do is upload an image of the original video (of Lil Yachty dancing on stage) and a character (the Joker) who will recreate those movements. Alternatively, you can upload an image of your character and some text prompts that explain how to animate it. As a third option, Viggle lets you create an animated character from scratch using only text prompts.

But memes are only a small part of Viggle's users. Chu says the models have been widely adopted as a visualization tool for creative people. Though the videos are far from perfect — shaky, with expressionless faces — Chu says they've proven effective for filmmakers, animators and video game designers to visually express their ideas. Currently, Viggle's models only create characters, but Chu hopes to be able to create more complex videos in the future.

Viggle currently offers a limited free version of its AI models on Discord and in its web app. The company also offers a $9.99 subscription for more capacity and gives select creators special access through its Creators Program. The CEO said Viggle is in talks with film and video game studios to license the technology, but is also seeing adoption among independent animators and content creators.

On Monday, Viggle announced it had raised $19 million in Series A funding led by Andreessen Horowitz with participation from Two Small Fish. The startup said the round will help Viggle scale, accelerate product development and expand its team. Viggle told TechCrunch that it partners with cloud providers such as Google Cloud to train and run its AI models. These partnerships with Google Cloud often include access to GPU and TPU clusters, but don't typically include using YouTube videos to train AI models.

Training Data

In TechCrunch's interview with Chu, we asked what kind of data Viggle's AI video model was trained on.

“Until now we've relied on publicly available data,” Chu said, echoing a response given by OpenAI CTO Mira Murati about Sora's training data.

When asked if Viggle’s training data set includes YouTube videos, Chu answered with a resounding “yes.”

That could be a problem: In April, YouTube CEO Neal Mohan told Bloomberg that using YouTube videos to train an AI text-video generator would be a “clear violation” of the platform's terms of service, in the context of OpenAI potentially using YouTube videos to train Sora.

Mohan revealed that Google, which owns YouTube, may have agreements with certain creators to use their videos in Google DeepMind's Gemini training dataset, but according to Mohan and YouTube's terms of service, the company is not allowed to scrape videos from the platform without first getting permission from the company.

After TechCrunch interviewed Viggle's CEO, a Viggle spokesperson emailed TechCrunch to retract Chu's comments, saying, “It was premature for the CEO to speak about whether Viggle uses YouTube data for training. In fact, Hang/Viggle cannot share details about training data.”

However, we pointed out that Chu has already done so publicly and asked for a clarification on the matter. In a response, a Viggle spokesperson confirmed that the AI ​​startup trains on YouTube videos.

Viggle generates AI content by leveraging a variety of public sources, including YouTube. Our training data is carefully curated and refined, adhering to all terms of service throughout the process. We prioritize maintaining strong relationships with platforms like YouTube, and are committed to respecting their terms of service by avoiding bulk downloads and other actions that lead to unauthorized video downloads.

This compliance effort seems to contradict comments made by Mohan in April that YouTube's video corpus is not a public source. We have reached out to YouTube and Google spokespeople but have not yet heard back.

The startup is in a gray area like others when it comes to using YouTube as training data. Many AI model developers, including OpenAI, Nvidia, Apple, and Anthropic, have been reported to use transcripts and clips from YouTube videos for training. It's a Silicon Valley dirty secret, but it's not that secret. Everyone probably does it. What's actually unusual is saying it out loud.



Source link

Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

OpenAI seeks to extend human lifespans with the help of longevity startups

January 17, 2025

Farewell to the $200 million woolly mammoth and TikTok

January 17, 2025

Nord Security founder launches Nexos.ai to help enterprises move AI projects from pilot to production

January 17, 2025

Data proves it remains difficult for startups to raise capital, even though VCs invested $75 billion in the fourth quarter

January 16, 2025

Apple suspends AI notification summaries for news after generating false alerts

January 16, 2025

Nvidia releases more tools and guardrails to help enterprises adopt AI agents

January 16, 2025

Leave A Reply Cancel Reply

Top Reviews
Editors Picks

7 days left: Founders and VCs save over $300 on all stage passes

March 24, 2025

AI chip startup Furiosaai reportedly rejecting $800 million acquisition offer from Meta

March 24, 2025

20 Hottest Open Source Startups of 2024

March 22, 2025

Andrill may build a weapons factory in the UK

March 21, 2025
About Us
About Us

Welcome to Tech Brunch, your go-to destination for cutting-edge insights, news, and analysis in the fields of Artificial Intelligence (AI), Cryptocurrency, Technology, and Startups. At Tech Brunch, we are passionate about exploring the latest trends, innovations, and developments shaping the future of these dynamic industries.

Our Picks

WWDC 2025: What to expect from this year's meeting

June 7, 2025

After data is wiped out, Kiranapro co-founders cannot rule out external hacks

June 7, 2025

Why investing in a growing AI startup is risky and more complicated

June 6, 2025

Subscribe to Updates

Subscribe to our newsletter and never miss our latest news

Subscribe my Newsletter for New Posts & tips Let's stay updated!

© 2025 TechBrunch. Designed by TechBrunch.
  • Home
  • About Tech Brunch
  • Advertise with Tech Brunch
  • Contact us
  • DMCA Notice
  • Privacy Policy
  • Terms of Use

Type above and press Enter to search. Press Esc to cancel.