

“What we’ve been doing over the last year, is solving the complex problem of photoreal facial synthesis”, explains Synthesia CTO, Dr. ‘Mike Putin’ using the original Face2Face demo, 2016
SYNTHESIA SOFTWARE FULL
The team is building a cloud platform to deliver this type of technology to a wide range of content creators soon and the company has the long-term goal of offering full scene synthesis through an automated but quality controlled cloud platform. It is now offering their breakthrough technology as a service, designed as a high end ADR professional service for professional lip sync, for select partners. They hope that this new approach will foster more respectful cultural exchanges and inclusive footage. Synthesia’s goal is to remove the language barrier from video and allow content from both high-end productions and YouTube influencers to reach a much larger audience, in any variety of languages. The resulting output is ideally completely seamless to the viewer. This enables translation without the problems of dubbing and mismatching lip sync.

‘Native dubbing’ is a new method of translating video content that utilises AI or Machine Learning to synchronise the lip movements of an actor to a new dialogue track. Synthesia isn’t producing throw away or comic illusions, they are seeking to address existing production problems in language dubbing and ADR. The service allows for seamlessly changing a presenter or actor’s expressions and dialogue. With a BBC project (see below) Synthesia is out of stealth mode and now offering their services for professional face replacement.
