Dozens of deepfake porn victims emerged in sextortion schemes last year

Reports of deepfake pornography and manipulated nude images in the Netherlands surged by 31 percent in 2024, according to data from Helpwanted, a national helpline for victims of online abuse. The organization received 59 reports last year, including 33 cases involving AI-generated images and 26 cases of altered photos or videos.

Justice Minister David van Weel and State Secretary Ingrid Coenradie detailed the increase in a letter to the Tweede Kamer. According to the officials, many cases involved sextortion, where victims were blackmailed with threats of exposure. In most instances, the images had not yet appeared on pornographic websites. However, in five cases, the manipulated content had already been published online.

Helpwanted has struggled to get deepfake pornography removed from platforms. In 2024, the organization did not submit individual removal requests for AI-generated content on pornographic sites. Instead, it filed a broad enforcement request with the Dutch Data Protection Authority on behalf of multiple victims, after a major content provider refused to comply with removal requests.

For smaller platforms, Helpwanted often advises victims to submit their own removal requests, as such platforms are less responsive to official takedown demands. Direct requests from individuals tend to be processed faster than those submitted by organizations without formal recognition as a “trusted flagger.”

To improve its effectiveness, Helpwanted applied for trusted flagger status under the European Digital Services Act (DSA) on Feb. 3. This designation would require online platforms to prioritize its takedown requests. The Authority for Consumers and Markets (ACM), which oversees digital services regulation in the Netherlands, is responsible for granting this status. If Helpwanted’s complaints are not handled swiftly after obtaining the designation, it can request enforcement action from the ACM.

The Tweede Kamer inquiry also questioned whether the Autoriteit Online Terroristisch en Kinderpornografisch Materiaal (ATKM) should play a role in combating deepfake pornography. The ATKM has the legal authority to act against child sexual abuse material and terrorist content but is not currently tasked with addressing other forms of harmful online content.

According to Van Weel and Coenradie, expanding the ATKM’s mandate is not being considered at this time. The agency, which was formally granted its current powers in July 2024, is still finalizing its enforcement processes. “Adding extra legal responsibilities is not appropriate at this stage,” they wrote in their letter to lawmakers.

Efforts to raise awareness about deepfake pornography and online exploitation continue. Offlimits, the organization overseeing Helpwanted, has launched multiple campaigns to educate the public. In October, it introduced the “Ik bepaal zelf” (“I decide for myself”) campaign, which emphasized that individuals should have control over their own images and personal data.

A second phase of the campaign will begin next week, reinforcing the message that victims can seek help from Helpwanted. The organization has also worked with the Kindertelefoon and other partners to provide educational materials for parents and teachers.

In collaboration with the University of Utrecht, Helpwanted is participating in research on young perpetrators of online sexual misconduct. The study, conducted with organizations including Stichting Halt, Rutgers, and the Dutch police, aims to evaluate the effectiveness of existing prevention and intervention programs.

Additionally, Offlimits is developing free e-health modules for victims of online sexual violence, including deepfake pornography. These resources will be available starting in March.