Meta is taking legal action to stop the spread of harmful AI generated images, videos and tools.
Meta announced today that they are pursuing legal action against a firm called Joy Timeline HK Limited, which is promoting an app named “CrushAI” which allows users to generate nude and sexually explicit pictures of people without their consent.
Meta-explained:
” We’re seeing an alarming increase in the number of ‘nudify apps’, which are using artificial intelligence to generate fake, non-consensual images. Meta’s rules have been against sexually explicit or non-consensual images for years. We have updated our policies so that it is even more clear that we do not allow promotion of nudify or other similar apps. When we are made aware of these ads, Facebook pages and Instagram accounts, we remove them. We also block the links that lead to their websites so that they cannot be accessed through Meta platforms. Finally, search terms such as ‘undress,’ ‘delete clothes’ and nudify on Facebook and Instagram will not show any results. “
Meta is still able to detect some of the tools, whether through user-generated posts or promotional material.
Meta is now targeting the app developers with its first attack on a Nudify application.
” In Hong Kong, the home of Joy Timeline HK Limited, we’ve brought a suit to stop them advertising CrushAI applications on Meta platforms. Joy Timeline HK Limited has repeatedly tried to bypass Meta’s ad-review process in order to continue posting these ads after being removed.
Meta is in a tough spot, as it wants people to create AI-based visuals with its apps, but it doesn’t like it when they use them for other, less desirable purposes.
What is likely to occur. The expansion of the Internet has shown us that every new innovation will amplify the negative aspects, even if that was not the intention. Generative AI is no exception.
Researchers from the University of Florida have reported that, as recently as last month, the number of sexually explicit AI images generated without consent of the subjects has increased significantly.
The technology can also be used to make images of children, and women are disproportionately targets in these apps.
Take It Down Act, a bill proposed by the National Center for Missing and Exploited Children (NCME), aims to pass official legislation that will outlaw images taken without consent, as well as other AI-related measures.
Meta is supporting this effort, as this new legal initiative represents another step in the fight to eliminate and discourage such tools.
They’ll never disappear completely. The history of the Internet tells us again that people will always find a reason to abuse the newest technology, including the ability to create adult images using AI.
This will, in theory, at least reduce the amount of content of this type and nudify app availability.