ByteDance said that, unlike some deepfake models that can animate only faces or upper bodies, its OmniHuman-1 could generate realistic full-body animations that sync gestures and facial expressions with speech or music.

A technical paper (reviewed by the South China Morning Post) highlights that OmniHuman-1 specialises in generating videos of individuals speaking, singing, and moving. The research team behind the model claims that its performance surpasses existing AI tools that generate human videos based on audio.

Generative AI models for videos are among the best examples to appreciate this. In line with this, a new launch by a very popular company promises to make deepfake videos 10x better. ByteDance, does that name ring a bell?

ByteDance has come up with a generative AI framework that can create highly realistic videos of a human based on a single image and motion signal.

Discover ByteDance's new AI technology, OmniHuman-1, which turns photos and audio clips into lifelike videos with accurate facial expressions and movements. Learn how this technology is shaping