Deepfake pornography

Deepfake pornography, or simply fake pornography, is a type of synthetic porn that is created via altering an already-existing pornographic publication by applying deepfake technology to the faces of the actor or actress. Deepfake porn has been very controversial, as it has been commonly used to place the faces of female celebrities onto porn performers' bodies, whose likeness is typically used without their consent.^[1]

History[]

Deepfake pornography prominently surfaced on the Internet in 2017, particularly on Reddit.^[2] The first one that captured attention was the Daisy Ridley deepfake, which was featured in several articles.^[2] Other prominent pornographic deepfakes were of various other celebrities.^[2][3][4][5] A report published in October 2019 by Dutch cybersecurity startup Deeptrace estimated that 96% of all deepfakes online were pornographic.^[6]

In December 2017, Samantha Cole published an article about r/deepfakes in Vice that drew the first mainstream attention to deepfakes being shared in online communities.^[7] Six weeks later, Cole wrote in a follow-up article about the large increase in AI-assisted fake pornography.^[8] Since 2017, Samantha Cole of Vice has published a series of articles covering news surrounding deepfake pornography.^{[9][10][11][12][5][13][7][8]}

Since then, multiple social media outlets have banned or made efforts to restrict deepfake pornography. Most notably, the r/deepfakes subreddit on Reddit was banned on February 7, 2018, due to the policy violation of "involuntary pornography".^{[14][15][16][17][18][19]} In the same month, representatives from Twitter stated that they would suspend accounts suspected of posting non-consensual deepfake content.^[13]

Scarlett Johansson, a frequent subject of deepfake porn, spoke publicly about the subject to The Washington Post in December 2018.^[20] In a prepared statement, she expressed that despite concerns, she would not attempt to remove any of her deepfakes, due to her belief that they do not affect her public image and that differing laws across countries and the nature of internet culture make any attempt to remove the deepfakes "a lost cause".^[20] While celebrities like herself are protected by their fame, however, she believes that deepfakes pose a grave threat to women of lesser prominence who could have their reputations damaged by depiction in involuntary deepfake pornography or revenge porn.^[20]

DeepNude[]

In June 2019, a downloadable Windows and Linux application called DeepNude was released which used neural networks, specifically generative adversarial networks, to remove clothing from images of women. The app had both a paid and unpaid version, the paid version costing $50.^[12] On June 27 the creators removed the application and refunded consumers, although various copies of the app, both free and for charge, continue to exist.^[21][22] On GitHub, the open-source version of this program called "open-deepnude"^[23] was deleted.^[24] The open-source version had the advantage of allowing to be trained on a larger dataset of nude images to increase the resulting nude image's accuracy level.^[25]

Deepfake CSAM[]

Deepfake technology has made the creation of child sexual abuse material (CSAM), also often referenced to as child pornography, faster, safer and easier than it has ever been. Deepfakes can be used to produce new CSAM from already existing material or creating CSAM from children who have not been subjected to sexual abuse. Deepfake CSAM can however have real and direct implications on children including defamation, grooming, extortion, and bullying.^[26] Additionally, deepfake child pornography produces further hurdles for police making criminal investigations and victim identification harder.^{[citation needed]}

Ethical debate[]

Deepfake pornography software can be misused to create pseudo revenge porn on an individual, which can be deemed a form of harassment.^[21]

Currently the footage produced by software such as DeepNude is still far from sophisticated enough to be indistinguishable from real footage under forensic analysis.^{[25][clarification needed]}

Efforts by companies to limit deepfake pornography footage[]

On January 31, 2018, Gfycat began removing all deepfakes from its site.^[11][27]

In February 2018, r/deepfakes was banned by Reddit for sharing involuntary pornography.^[19] Other websites have also banned the use of deepfakes for involuntary pornography, including the social media platform Twitter and the pornography site Pornhub.^[13] However, some websites have not banned deepfake content, including 4chan and 8chan.^[28]

Also in February 2018, Pornhub said that it would ban deepfake videos on its website because it is considered "non consensual content" which violates their terms of service.^[10] They also stated previously to Mashable that they will take down content flagged as deepfakes.^[29] Writers from Motherboard from Buzzfeed News reported that searching "deepfakes" on Pornhub still returned multiple recent deepfake videos.^[10]

The chat site Discord has taken action against deepfakes in the past,^[30] and has taken a general stance against deepfakes.^[27][31] In September 2018, Google added "involuntary synthetic pornographic imagery" to its ban list, allowing anyone to request the block of results depicting their fake nudes.^[32]

References[]