Vibe coding sexual violence
69107
wp-singular,post-template-default,single,single-post,postid-69107,single-format-standard,wp-theme-bridge,wp-child-theme-WACC-bridge,bridge-core-3.3.5,qodef-qi--touch,qi-addons-for-elementor-1.11.2,qode-page-transition-enabled,ajax_fade,page_not_loaded,,qode-title-hidden,qode-smooth-scroll-enabled,qode-child-theme-ver-1.0.0,qode-theme-ver-30.9.1,qode-theme-bridge,qode_header_in_grid,qode-wpml-enabled,wpb-js-composer js-comp-ver-9.0.1,vc_responsive,elementor-default,elementor-kit-41156
Illustration of a photo with a woman on the screen whose photo has been nudified. The photo is blurred and non-explicit. In the background is a man working at a laptop

Vibe coding sexual violence

Have you ever wondered while doomscrolling on social media how those cute dancing cat videos are made? More than 100 apps on Google and Apple stores make it possible to do just that – superimpose a face or body on an existing one.

That’s “vibe coding,” so named by OpenAI cofounder Andrej Karpathy, a type of coding “where you fully give in to the vibes, embrace exponentials, and forget that the code even exists.” As well as the ability to turn a cat into a tap dancer, vibe coding gives anyone with an idea the power to create their own app, to build software using AI by simply describing in plain language what you want. It’s astounding how simple and fast the process is.

I decided to test the limits of this technology myself. The AI app generator asked, “what will you build next?” and delivered what it promised. A couple of slick, stylish, beautifully designed apps based on the prompts I fed it and tweaked following its suggestions. All in a time span of under an hour.

Vibe coding enables beginners to churn out apps with AI at little financial risk, high potential returns – and little to no accountability.

Some app creators hide features designed for sexual violence behind harmless looking interfaces. A WIRED investigation discovered some 400 apps and websites that look like regular AI tools but had secret features that let users create sexually abusive deepfakes.

Another study, by Tech Transparency Project, found that nudify apps (apps capable of undressing a person) found in its Google and Apple store searches had been “downloaded 483 million times and made more than $122 million in lifetime revenue.”

Thirty-five years since the first international 16 Days campaign to end gender-based violence, the capacity to innovate new methods of perpetrating violence has increased massively. AI has dramatically scaled up capabilities for communication violence by arming perpetrators – no coding knowledge required.

WIRED’s recent research found that students in at least 28 countries have been victimized by AI-generated deepfake nude image. Nearly all deepfakes – 98% – are sexualized images and pornography, and 99% of this content is targeting women, according to Kalliopi Mingeirou, Chief of Ending Violence Against Women Section at UN Women.

In April this year, three women in Arizona sued the alleged operators of AI ModelForge, a coaching business that teaches paying subscribers how to scrape real women’s photos from public accounts, feed them into the app to train a likeness model, and run a separate app to remove clothing and generate sexually explicit content. That the lawsuit is still ongoing indicates a legal battle that will hinge on questions of platform responsibility for AI-generated harms.

As we look ahead to the beginning of this year’s 16 Days campaign next week, the words of UN Women’s Kalliopi Mingeirou underline the need for AI accountability: “Safety and equality cannot be an afterthought. It has to be baked into the life cycle of AI – from development, deployment, procurement, to constant audits that will oversee the use of AI in its life cycle. Because ultimately, if we do not do that and if we move in the phase that we are moving now, what we will do is we will use a 21st-century technology to automate the inequalities of the 20th century.”

Image generated by Canva AI and edited by WACC staff.