Connect with us

Business

Will AI make language dubbing easy for film and TV?

Published

on

Will AI make language dubbing easy for film and TV?


Suzanne Bearne

Technology Reporter

XYZ Films A still from the movie Watch the Skies where a young woman and a man stare into the night sky.XYZ Films

Swedish movie Watch the Skies was dubbed into English using AI

Finding international films that might appeal to the US market is an important part of the work XYZ Films.

Maxime Cottray is the chief operating officer at the Los Angeles-based independent studio.

He says the US market has always been tough for foreign language films.

“It’s been limited to coastal New York viewers through art house films,” he says.

It’s partly a language problem.

“America is not a culture which has grown up with subtitles or dubbing like Europe has,” he points out.

But that language hurdle might be easier to clear with a new AI-driven dubbing system.

The audio and video of a recent film, Watch the Skies, a Swedish sci-fi film, was fed into a digital tool called DeepEditor.

It manipulates the video to make it look like actors are genuinely speaking the language the film is made into.

“The first time I saw the results of the tech two years ago I thought it was good, but having seen the latest cut, it’s amazing. I’m convinced that if the average person if saw it, they wouldn’t notice it – they’d assume they were speaking whatever language that is,” says Mr Cottray.

The English version of Watch The Skies was released in 110 AMC Theatres across the US in May.

“To contextualise this result, if the film were not dubbed into English, the film would never have made it into US cinemas in the first place,” says Mr Cottray.

“US audiences were able to see a Swedish independent film that otherwise only a very niche audience would have otherwise seen.”

He says that AMC plans to run more releases like this.

Flawless Editor software shows an actors performance being transformed into a different language by the DeepEditor softwareFlawless

DeepEditor can translate a performance into a different language

DeepEditor was developed by Flawless, which is headquartered in Soho, London.

Writer and director Scott Mann founded the company in 2020, having worked on films including Heist, The Tournament and Final Score.

He felt that traditional dubbing techniques for the international versions of his films didn’t quite match the emotional impact of the originals.

“When I worked on Heist in 2014, with a brilliant cast including Robert De Niro, and then I saw that movie translated to a different language, that’s when I first realised that no wonder the movies and TV don’t travel well, because the old world of dubbing really kind of changes everything about the film,” says Mr Mann, now based in Los Angeles.

“It’s all out of sync, and it’s performed differently. And from a purist filmmaking perspective, a very much lower grade product is being seen by the rest of the world.”

Flawless Scott Mann, the founder of Flawless, smiling and dressed casually.Flawless

Scott Mann founded Flawless in 2020

Flawless developed its own technology for identifying and modifying faces, based on a method first presented in a research paper in 2018.

“DeepEditor uses a combination of face detection, facial recognition, landmark detection [such as facial features] and 3D face tracking to understand the actor’s appearance, physical actions and emotional performance in every shot,” says Mr Mann.

The tech can preserve actors’ original performances across languages, without reshoots or re-recordings, reducing costs and time, he says.

According to him, Watch the Skies was the world’s first fully visually-dubbed feature film.

As well as giving an actor the appearance of speaking another language, DeepEditor can also transfer a better performance from one take into another, or swap a new line of dialogue, while keep the original performance with its emotional content intact.

Thanks to the explosion of streaming platforms such as Netflix and Apple, the global film dubbing market is set to increase from US$4bn (£3bn) in 2024 to $7.6bn by 2033, according to a report by Business Research Insights.

Mr Mann won’t say how much the tech costs but says it varies per project. “I’d say it works out at about a tenth of the cost of shooting it or changing it any other way.”

His customers include “pretty much all the really big streamers”.

Mr Mann believes the technology will enable films to be seen by a wider audience.

“There is an enormous amount of incredible kind of cinema and TV out there that is just never seen by English speaking folks, because many don’t want to watch it with dubbing and subtitles,” says Mr Mann.

The tech isn’t here to replace actors, says Mann, who says voice actors are used rather than being replaced with synthetic voices.

“What we found is that if you make the tools for the actual creatives and the artists themselves, that’s the right way of doing it… they get kind of the power tools to do their art and that can feed into the finished product. That’s the opposite of a lot of approaches that other tech companies have taken.”

Natan Dvir Neta Alexander in a blue jacketNatan Dvir

Neta Alexander is concerned about a “monolingual” film culture

However, Neta Alexander, assistant professor of film and media at Yale University, says that while the promise of wider distribution is tempting, using AI to reconfigure performances for non-native markets risks eroding the specificity and texture of language, culture, and gesture.

“If all foreign films are adapted to look and sound English, the audience’s relationship with the foreign becomes increasingly mediated, synthetic, and sanitised,” she says.

“This could discourage cross-cultural literacy and disincentivise support for subtitled or original-language screenings.”

Meanwhile, she says, the displacement of subtitles, a key tool for language learners, immigrants, deaf and hard-of-hearing viewers and many others, raises concerns about accessibility.

“Closed captioning is not just a workaround; it’s a method of preserving the integrity of both visual and auditory storytelling for diverse audiences,” says Prof Alexander.

Replacing this with automated mimicry suggests a disturbing turn toward commodified and monolingual film culture, she says.

“Rather than ask how to make foreign films easier for English-speaking audiences, we might better ask how to build audiences that are willing to meet diverse cinema on its own terms.”

More Technology of Business



Source link

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Business

Iran war: Oil prices jump above $100 for first time in four years

Published

on

Iran war: Oil prices jump above 0 for first time in four years



Major disruption to energy supplies threatens to push up prices for consumers and businesses around the world.



Source link

Continue Reading

Business

Aramco scrips surge 4%, most in three years – The Times of India

Published

on

Aramco scrips surge 4%, most in three years – The Times of India


Saudi Aramco jumped the most since April 2023 on Sunday as the Iran war entered its second week, prompting supply disruptions that may send oil prices higher when global markets reopen. Shares of the state-backed oil giant climbed as much as 4.9% in Riyadh before paring gains to close up 4.1%, on the first day of trading for the stock since Brent crude prices topped $90 a barrel on Friday.Brent may climb further after UAE and Kuwait started reducing oil production amid a near-closure of Strait of Hormuz waterway, adding to interruptions affecting worldwide energy supply and exports. “For Aramco, we believe that the gain in oil prices would offset a decline in exports,” said Junaid Ansari, head of research and strategy at Kamco Investment Co. “We also believe that Aramco should be able to re-route a bulk of its shipments to the Red Sea. It’s just about logistics and handling the excess capacity.” Aramco has been redirecting oil cargoes to Red Sea facilities on Saudi Arabia’s west coast to avoid the Strait of Hormuz.



Source link

Continue Reading

Business

Gulf war risks global economic shock | The Express Tribune

Published

on

Gulf war risks global economic shock | The Express Tribune



ISLAMABAD:

The Middle East once again stands on the verge of a dangerous escalation. What began as a confrontation between Iran and Israel risks evolving into a broader regional conflict involving the Gulf states and major global powers. Such a development would carry profound implications for global energy security and economic stability.

The big war clouds gathering over the Gulf are not merely a regional security concern. They represent a geopolitical confrontation with the potential to reshape global energy markets, international trade and economic stability. If the current escalation expands into a wider Gulf conflict, the shockwaves will be felt far beyond the Middle East.

The rapidly intensifying tensions in the region risk transforming what began as limited strikes and retaliatory attacks between Iran and Israel, backed by the United States and its allies, into a broader regional confrontation. Increasing missile and drone exchanges have heightened fears that the Gulf Cooperation Council (GCC) states may become directly involved. Should this happen, the Middle East could once again become the epicentre of a conflict with global consequences.

The Gulf occupies a uniquely strategic position in the global economy, both for sea and air routes. Nearly one-third of the world’s seaborne oil trade passes through the Strait of Hormuz, making it one of the most sensitive chokepoints in international commerce. Even a temporary disruption in this narrow corridor can trigger volatility in energy markets, driving up oil and LNG prices, increasing transport costs and fuelling inflation worldwide.

History offers a sobering reminder that conflicts in the Gulf rarely remain localised. From the Iran-Iraq war in the 1980s to the Gulf wars that followed, instability in the region has repeatedly reshaped global energy markets and geopolitical alliances. The current escalation carries similar risks at a time when the global economy is already grappling with inflation, supply chain disruptions and geopolitical fragmentation.

Beyond the immediate military dimension, the crisis must also be understood within the broader context of global power competition. The Middle East has long been central to international geopolitics due to its vast energy reserves and its geographic location linking Asia, Europe and Africa. Control over energy supply routes has historically been a key determinant of global influence.

In today’s evolving geopolitical landscape, this factor has gained renewed significance. China, now one of the world’s largest energy consumers, relies heavily on oil imports from the Middle East. Any disruption in regional energy supplies would therefore have consequences not only for global energy markets but also for the balance of economic power among major economies.

Behind the immediate military confrontation lies a deeper strategic contest shaping global geopolitics. The Gulf remains central to the control of energy flows that sustain the world economy, and influence over these supply routes has historically translated into geopolitical leverage. As emerging economies, particularly China, depend heavily on Middle Eastern energy imports, disruptions or shifts in regional alliances could alter the balance of economic influence among major global powers. In this sense, the current escalation reflects not only regional rivalries but also a broader strategic competition unfolding across the international system.

For the Gulf states themselves, the stakes are particularly high. Over the past several decades, many GCC economies have pursued ambitious strategies to diversify beyond oil by investing in financial services, logistics, real estate development, tourism and advanced industries. These economic transformation plans depend heavily on regional stability, peace and investor confidence.

A prolonged military confrontation would threaten these gains. Conflict in the initial days has already disrupted airlines and shipping routes, endangered energy infrastructure and triggered capital flight from regional markets. Brent surged near $85 per barrel. LNG shipping rates soared 650% to $300,000 per day. QatarEnergy declared force majeure, shut down production and halted LNG supplies. Export cargoes of essential food commodities such as rice, fresh fruits and vegetables have halted at various points of origin, endangering the food security of GCC states, particularly those small states with limited local production.

Rising defence expenditures may also divert resources away from long-term development priorities such as infrastructure, education and technological innovation. Another troubling dimension of the current tensions is the risk that geopolitical rivalry may increasingly be framed through sectarian narratives. Relations between Iran and several Gulf states already contain elements of Sunni-Shia competition. If the confrontation intensifies, sectarian polarisation could deepen divisions across the region and make diplomatic solutions more difficult.

Such a development would weaken the Muslim world economically and politically and may send it back to conditions reminiscent of the 1960s. Instead of focusing on economic modernisation, innovation and human capital development, states could find themselves allocating growing resources to defence procurement and military alliances.

For countries like Pakistan, the economic consequences of a wider Gulf war would be immediate and significant. Pakistan remains heavily dependent on imported fuel from Saudi Arabia, the wider Middle East and LNG from Qatar. Food commodities are imported from global sources, and any sharp increase in global energy, shipping costs and food prices would widen the country’s trade deficit by around $4-5 billion and intensify inflationary pressures, while exacerbating the current account deficit.

Furthermore, Pakistan’s external trade relies substantially on foreign shipping companies. War-risk insurance premiums, higher sea freight charges and disruptions in maritime routes would raise the cost of both imports and exports. These pressures would further strain an economy already navigating fiscal and external sector challenges.

Remittances present another important concern, providing a cushion for the current account. Millions of Pakistani workers are employed across Gulf economies and send a major share of remittances from Gulf countries. Any economic slowdown or instability in the region could affect employment opportunities and remittance inflows – one of Pakistan’s most vital sources of foreign exchange and rupee stability.

At this critical moment, restraint and diplomacy are essential. Escalation may serve short-term strategic objectives, but the long-term costs of a wider regional war would be immense. The Middle East has already endured decades of instability and conflict; another large-scale confrontation would deepen humanitarian suffering while undermining economic progress.

History offers a clear lesson: wars in the Gulf rarely remain confined to the region. They reshape global markets, redraw alliances and influence the trajectory of the world economy. Preventing such an outcome requires diplomacy, dialogue and leadership capable of recognising the heavy cost of further escalation.

The Gulf has long been the world’s energy heartland; turning it into a battlefield would endanger not only regional stability but the foundations of the global economy itself.

The writer is a former vice president of KCCI, an independent economic analyst focusing on global trade, energy economics and geopolitical risk



Source link

Continue Reading

Trending