TikTok parent company ByteDance unveils OmniHuman, an AI system that can generate realistic videos of people from just one picture.

In a recently published research paper on arXiv, Bytedance announced the development of a new AI tool capable of working seamlessly with images of any aspect ratio.

A technical paper (reviewed by the South China Morning Post) highlights that OmniHuman-1 specialises in generating videos of individuals speaking, singing, and moving. The research team behind the model claims that its performance surpasses existing AI tools that generate human videos based on audio.

In a black and white video, OmniHuman-1 shows the known scientist Albert Einstein talking in front of a blackboard performing hand gestures and showing facial expressions. ByteDance says it trained the new tool on more than 18,700 hours of human videos, combining it with various types of inputs like text, audio and physical poses.

This AI framework is designed to generate lifelike human motion and speech from minimal input-just an image and an audio sample-solving a key challenge in AI-driven video creation

ByteDance said that, unlike some deepfake models that can animate only faces or upper bodies, its OmniHuman-1 could generate realistic full-body animations that sync gestures and facial expressions with speech or music.

ByteDance, the tech giant behind TikTok, has introduced an artificial intelligence (AI) model that is gaining widespread attention for its ability to transform photos and sound bites into realistic videos,

Generative AI models for videos are among the best examples to appreciate this. In line with this, a new launch by a very popular company promises to make deepfake videos 10x better. ByteDance, does that name ring a bell?

ByteDance has come up with a generative AI framework that can create highly realistic videos of a human based on a single image and motion signal.