Golden Globe-winning movie The Brutalist and Emilia Pérez have come under fire for using AI to change actors ‘ voices in their properly acclaimed films.

” The Minimalist,” starring Adrien Brody, Felicity Jones, and Guy Pearce, depicts a visionary architect who, after escaping post Europe, revitalizes his life and career in America with the help of a powerful entrepreneur.

” Emilia Pérez,” however, follows Manitas del Monte, a Hispanic gang director who becomes Emilia Pérez, played by Karla Sofia Gascon.

Alongside her attorney Rita, played by Zoe Saldaña, and family Jessi, played by Selena Gomez, the picture intertwines their extraordinary transformations with music scenes.

AI discussion

The present controversy comes on the feet of a months-long attack in 2023, where Hollywood’s use of artificial knowledge in lieu of paid individual actors was a hot-button problem.

But in an interview  with Red Shark News, Hungary-born editor Dávid Jancs ó revealed how the AI-powered tool Respeecher—like Autotune for dialogue—enhanced the Hungarian pronunciation of the film’s two lead actors.

“ I am a native Hungarian speaker and I know that it is one of the most difficult languages to learn to pronounce, ” Jancs ó said. “It’s an incredibly distinctive language. We coached [Brody and Jones ] and they did a wonderful job but we also wanted to best it so that never yet citizens will place any change. ”

According to Jancsó, stars Adrien Brody and Felicity Jones were ashore with the use of AI to enhance their tones using his own.

“Most of their Hungarian speech has a part of me talking in it,” he said. ” We were very careful about keeping their achievements. It’s generally simply replacing characters here and there. You can do this in ProTools yourself, but we had but little speech in Hungarian that we really needed to speed up the process. ”

One of the problems that SAG-AFTRA people had during the 2023 cuts was that AI would be used to remove them and that their portraits would be used without payment.

“The most important point is that we’re talking about emerging technologies that is going to affect the entire world, ” SAG-AFTRA director Zeke Alton previously told during a press Q& A.

“We really happen to be the canaries in the coal mine. We’re setting a precedent for how the labor in public, both the United States and around the globe, is going to be treated, ” they said.

While the use of AI in film productions remains controversial, Artificial engineers cheered the use of the systems.

” The Minimalist” production used GenAI from Ukrainian Respeecher to subtly increase American players ‘ language of Hungarian, notably difficult to learn & speak, ” Sr. Staff Researcher at Google Deepmind Alex Polozov said on X ( formerly Twitter ). Wonderful example of using AI tools to improve well-known art development approach, never replace it. ”

The Brutalist producer Brady Corbet addressed the controversy in an appointment with Indiewire.

“Adrien and Felicity’s shows are totally their individual. They worked for months with dialect coach Tanera Marshall to perfect their voices, ” Corbet said. “Innovative Respeecher systems was used in Hungarian speech dialogue editing simply, especially to develop specific vowels and letters for accuracy. No English speech was changed. ”

Corbet added that AI was used in post-production to keep “the sincerity of Adrien and Felicity’s performances in another speech, not to remove or change them, and done with the utmost regard for the craft. ”

For his part, Jancs ó defended using AI in The Brutalist, emphasizing its role as a practical tool rather than a groundbreaking innovation.

“We should be having a very open discussion about what tools AI can provide us with, ” he said. “There’s nothing in the film using AI that has n’t been done before. It just makes the process a lot faster. We use AI to create these tiny little details that we did n’t have the money or the time to shoot. ”

A case for AI voice enhancement

In May, during an interview at the Cannes Film Festival, Cyril Holtz, the sound mixer for Emilia Pérez, highlighted the practical applications of technologies like Respeecher, a voice and image cloning software to extend the vocal range of Gascon.

” It started as a plan B but became plan A,” Holtz said.

Respeecher has been used to clone the voices of iconic actors, including “It’s a Wonderful Life ” star Jimmy Stewart, Elvis Presley, James Earl Jones, and Cyberpunk 2077: Phantom Liberty voice actor Miłogost “Milek ” Reczek, who passed away in 2021.

” Voice actors are —and will always be—an essential part of quality AI voice synthesis, ” Respeecher CEO Alex Serdiuk said in a statement posted on X.

“We developed Respeecher as an auxiliary tool that helps voice actors scale, monetize, and secure their voices. One of our guiding principles is’Empower, not replace. ‘”

Generally Intelligent Newsletter

A weekly AI journey narrated by Gen, a generative AI model.

Share This Story, Choose Your Platform!