Report: Hugging Face AI Models Used to Easily Create Nudity
A report by European nonprofit AI Forensics found that Hugging Face hosts open-source AI models that readily create inappropriate content. Seven of nine tested image editing models generated nudity from simple prompts.
A report from the European nonprofit AI Forensics indicates that Hugging Face, a popular repository for open-source AI models, is hosting tools that can be easily used to generate inappropriate content. The research found that seven out of nine tested image editing models readily complied with prompts to undress depictions of women and children.
Unlike major generative AI models such as Google's Gemini and OpenAI's ChatGPT, which typically have safeguards to block sexually explicit requests, the models examined on Hugging Face appeared to lack such restrictions, according to the report.
The AI Forensics analysis focused on the ease with which these models could be used to create non-consensual deepfakes. The study highlights concerns about the potential misuse of open-source AI tools when adequate safety measures are not implemented.
Hugging Face serves as a significant platform for open-source AI development. This report raises questions regarding the company's responsibility for content moderation and security protocols on its platform.