ByteDance said that, unlike some deepfake models that can animate only faces or upper bodies, its OmniHuman-1 could generate realistic full-body animations that sync gestures and facial expressions with speech or music.

A technical paper (reviewed by the South China Morning Post) highlights that OmniHuman-1 specialises in generating videos of individuals speaking, singing, and moving. The research team behind the model claims that its performance surpasses existing AI tools that generate human videos based on audio.

ByteDance, the tech giant behind TikTok, has introduced an artificial intelligence (AI) model that is gaining widespread attention for its ability to transform photos and sound bites into realistic videos,

Discover ByteDance's new AI technology, OmniHuman-1, which turns photos and audio clips into lifelike videos with accurate facial expressions and movements. Learn how this technology is shaping

ByteDance has come up with a generative AI framework that can create highly realistic videos of a human based on a single image and motion signal.