Saudi Press

Saudi Arabia and the world
Thursday, Oct 02, 2025

Deepfake videos 'double in nine months'

Deepfake videos 'double in nine months'

About 14,700 computer-generated face-swap videos, most of which are pornographic, have been flagged.

New research shows an alarming surge in the creation of so-called deepfake videos, with the number online almost doubling in the last nine months. There is also evidence that production of these videos is becoming a lucrative business.

And while much of the concern about deepfakes has centred on their use for political purposes, the evidence is that pornography accounts for the overwhelming majority of the clips.

The research comes from cyber-security company Deeptrace. Its researchers found 14,698 deepfake videos online, compared with 7,964 in December 2018.

They said 96% were pornographic in nature, often with a computer-generated face of a celebrity replacing that of the original adult actor in a scene of sexual activity.

While many of the subjects featured were American and British actresses, the researchers found that South Korean K-Pop singers were also commonly inserted into fake videos, highlighting that this is a global phenomenon.

The report does highlight the potential for the use of deepfake technology to be used in political campaigns. But in the two cases it highlights - in Gabon and Malaysia - the allegations that faked videos had been used turned out to be incorrect.

What seems clear, though, is that the real danger at the moment is the use of the technology in revenge porn and cyber-bullying.

- Google makes deepfakes to fight deepfakes


- 'Deepfake' app causes fraud and privacy fears in China


- Facebook puts $10m into effort to spot deep fake videos


Henry Ajder, head of research analysis at Deeptrace, says too much of the discussion of deepfakes misses the mark.

"The debate is all about the politics or fraud and a near-term threat, but a lot of people are forgetting that deepfake pornography is a very real, very current phenomenon that is harming a lot of women," he explains.


Fake images, real money


Deeptrace's very existence is evidence of how rapidly the deepfake phenomenon has become a concern for corporations and governments.

It describes its mission as protecting "individuals and organisations from the damaging impacts of AI- generated synthetic media".

The term deepfake was first coined in a Reddit post in 2017, and this report explains that in just two years a whole industry has emerged to profit from this phenomenon.

Deeptrace found that the four leading deepfake-themed pornography websites, supported by advertising, had attracted 134 million views for their videos since February 2018.

Apps making it possible to create this material are now proliferating.

One that allowed users to synthetically remove the clothes from still images of women charged $50 (£40) for removing a watermark from each finished product.

Visits to the app's website surged after a critical article was written about it, and the owners took it down.

But the software is still out there, repackaged by others seeking to profit from it.

One independent expert highlighted that other software has also made it much easier to create fake videos than before.

"It's now become possible to create a passable deepfake with only a small amount of input material - the algorithms need smaller and smaller amounts of video or picture footage to train on," explained Katja Bego, principal researcher at innovation foundation Nesta.

"As the technology is advancing so rapidly, it is important for policymakers to think now about possible responses. This means looking at developing detection tools and raising public awareness, but also [to] consider the underlying social and political dynamics that make deepfakes potentially so dangerous."

The authors of the Deeptrace report also describe service portals - online businesses generating and selling deepfake videos.

One such portal required 250 photos of the target subject and two days of processing to generate a video. Deeptrace says the prices charged vary but can be as little as $2.99 per video.

Another report earlier this year by the Witness Media Lab, a collaboration between a human-rights organisation and Google, found that creating deepfake videos still requires some skill - but that is changing quickly.

The report says right now simulating actual faces completely realistically still involves a significant team of people with specialised skills and technology.

But the lengthy process is being automated, allowing people without that specialist knowledge to make videos that may be less sophisticated but can be generated much faster.

Looking at videos flagged with the deepfake hashtag on YouTube, there are some impressive examples of how the technology is being used by professional teams.

One video where The Shining suddenly features Jim Carrey in the Jack Nicholson role, is made by an artist called Ctrl Shift Face.

The anonymous creator helpfully warns on his channel: "Do not believe everything that you see on the internet, OK?"

Ctrl Shift Face's aim is to entertain rather than deceive. But there are obviously fears that such fakery could be used to sway an election campaign or whip up hatred against a particular group.

So far, however, there appear to be few, if any, instances of deepfakes succeeding in fooling people for malevolent purposes.

Now, as a business set up to protect organisations from this phenomenon, it could be in the interests of Deeptrace to hype this threat. And Ms Bego questioned whether deepfake-detection technology is the right approach.

"A viral video can reach an audience of millions and make headlines within a matter of hours," she explained.

"A technological arbiter telling us the video was doctored after the fact might simply be too little too late."

In any case, it appears that in the short term the real victims of malicious users of deepfake videos will not be governments and corporations but individuals, most of them women.

It is unlikely that they will be able to afford to hire specialists to combat their abusers.

Newsletter

Related Articles

Saudi Press
0:00
0:00
Close
Altman Says GPT-5 Already Outpaces Him, Warns AI Could Automate 40% of Work
Trump Organization Teams with Saudi Developer on $1 Billion Trump Plaza in Jeddah
Electronic Arts to Be Taken Private in Historic $55 Billion Buyout
Colombian President Petro Vows to Mobilize Volunteers for Gaza and Joins List of Fighters
Nvidia and Abu Dhabi’s TII Launch First AI-&-Robotics Lab in the Middle East
UK, Canada, and Australia Officially Recognise Palestine in Historic Shift
New Eye Drops Show Promise in Replacing Reading Glasses for Presbyopia
Dubai Property Boom Shows Strain as Flippers Get Buyer’s Remorse
Top AI Researchers Are Heading Back to China as U.S. Struggles to Keep Pace
JWST Data Brings TRAPPIST-1e Closer to Earth-Like Habitability
UAE-US Stargate Project Poised to Make Abu Dhabi a Global AI Powerhouse
Trump and Starmer Clash Over UK Recognition of Palestinian State Amid State Visit
Saudi Arabia cracks down on music ‘lounges’ after conservative backlash
Saudi Arabia Signs ‘Strategic Mutual Defence’ Pact with Pakistan, Marking First Arab State to Gain Indirect Access to Nuclear Strike Capabilities in the Region
Sam Altman sells the 'Wedding Estate' in Hawaii for 49 million dollars
Turkish car manufacturer Togg Enters German Market with 5-Star Electric Sedan and SUV to Challenge European EV Brands
World’s Longest Direct Flight China Eastern to Launch 29-Hour Shanghai–Buenos Aires Direct Flight via Auckland in December
New OpenAI Study Finds Majority of ChatGPT Use Is Personal, Not Professional
Kuwait opens bidding for construction of three cities to ease housing crunch.
This Week in AI: Meta’s Superintelligence Push, xAI’s Ten Billion-Dollar Raise, Genesis AI’s Robotics Ambitions, Microsoft Restructuring, Amazon’s Million-Robot Milestone, and Google’s AlphaGenome Update
Indian Student Engineers Propose “Project REBIRTH” to Protect Aircraft from Crashes Using AI, Airbags and Smart Materials
Could AI Nursing Robots Help Healthcare Staffing Shortages?
Turkish authorities seize leading broadcaster amid fraud and tax investigation
Qatari prime minister says Netanyahu ‘killed any hope’ for Israeli hostages
Apple Introduces Ultra-Thin iPhone Air, Enhanced 17 Series and New Health-Focused Wearables
Big Oil Slashes Jobs and Investments Amid Prolonged Low Crude Prices
Social Media Access Curtailed in Turkey After CHP Calls for Rallies Following Police Blockade of Istanbul Headquarters
Did the Houthis disrupt the internet in the Middle East? Submarine cables cut in the Red Sea
Gold Could Reach Nearly $5,000 if Fed Independence Is Undermined, Goldman Sachs Warns
Uruguay, Colombia and Paraguay Secure Places at 2026 World Cup
Trump Administration Advances Plans to Rebrand Pentagon as Department of War Instead of the Fake Term Department of Defense
Tether Expands into Gold Sector with Profit-Driven Diversification
Trump’s New War – and the ‘Drug Tyrant’ Fearing Invasion: ‘1,200 Missiles Aimed at Us’
At the Parade in China: Laser Weapons, 'Eagle Strike,' and a Missile Capable of 'Striking Anywhere in the World'
Information Warfare in the Age of AI: How Language Models Become Targets and Tools
Israeli Airstrike in Yemen Kills Houthi Prime Minister
After the Shock of Defeat, Iranians Yearn for Change
YouTube Altered Content by Artificial Intelligence – Without Permission
Iran Faces Escalating Water Crisis as Protests Spread
More Than Half a Million Evacuated as Typhoon Kajiki Heads for Vietnam
HSBC Switzerland Ends Relationships with Over 1,000 Clients from Saudi Arabia, Lebanon, Qatar, and Egypt
Sharia Law Made Legally Binding in Austria Despite Warnings Over 'Incompatible' Values
Dogfights in the Skies: Airbus on Track to Overtake Boeing and Claim Aviation Supremacy
Tim Cook Promises an AI Revolution at Apple: "One of the Most Significant Technologies of Our Generation"
Are AI Data Centres the Infrastructure of the Future or the Next Crisis?
Miles Worth Billions: How Airlines Generate Huge Profits
Zelenskyy Returns to White House Flanked by European Allies as Trump Pressures Land-Swap Deal with Putin
Beijing is moving into gold and other assets, diversifying away from the dollar
Cristiano Ronaldo Makes Surprise Stop at New Hong Kong Museum
Zelenskyy to Visit Washington after Trump–Putin Summit Yields No Agreement
×