A YouTube advertisement for an AI-powered content tool has been outlawed by the advertising standards body after it appeared to suggest users could remove clothing from a woman.
The Controversial Promo
The ad in question, viewed in January, featured a comparison image of a female subject. The initial picture had a red overlay over her midriff, while the second exposed bare skin. On-screen text read: "Erase anything" followed by a heart-eyes emoji.
"Because the ad implied that viewers could use an app to erase a person's attire, we deemed it condoned digitally altering and revealing women's bodies non-consensually," announced the authority.
User Reports and Decision
Several people lodged objections to the standards authority, stating it was harmful, sexualised women, and included problematic tropes.
The ASA ruled that while the app's owner, Saeta Tech, bans users from creating sexually explicit content, the commercial's suggestion was misleading. The commercial was subsequently outlawed for being "offensive" and likely to cause "widespread offense".
Official Statement
Saeta Tech acknowledged it recognized why the ad was offensive, but placed the blame its "marketing approach", not the product's purpose. The firm noted it employs automated detection to prevent the generation of explicit content.
The company has agreed not to display the ad again and has halted all marketing while it undertakes an internal review.
Wider Issue
This incident highlights a global discussion about non-consensual image manipulation apps. In early 2024, similar issues made headlines when Elon Musk's chatbot was allegedly used to flood the site formerly known as Twitter with sexualised images.
Subsequently, the UK government announced in December to make it illegal to develop or distribute AI tools that allow the non-consensual removal of clothing. These legislative changes will complement existing legislation against revenge porn.
Summary Points
- An advertisement for a digital tool has been prohibited for suggesting it could create nude images.
- The ASA ruled it was irresponsible and offensive.
- The company apologized for the marketing but stated the tool's safeguards.
- This incident takes place against a backdrop of legal action targeting 'nudification' software.