Microsoft’s AI text-to-image generator, Copilot Designer, appears to be heavily filtering outputs after a Microsoft engineer, Shane Jones, warned that Microsoft has ignored warnings that the tool randomly creates violent and sexual imagery, CNBC reported.
Jones told CNBC that he repeatedly warned Microsoft of the alarming content he was seeing while volunteering in red-teaming efforts to test the tool’s vulnerabilities. Microsoft failed to take the tool down or implement safeguards in response, Jones said, or even post disclosures to change the product’s rating to mature in the Android store.
Instead, Microsoft apparently did nothing but refer him to report the issue to OpenAI, the maker of the DALL-E model that fuels Copilot Designer’s outputs.
OpenAI never responded, Jones said, so he took increasingly more drastic steps to alert the public to issues he found in Microsoft’s tool.
He started by posting an open letter, calling out OpenAI on LinkedIn. Then, when Microsoft’s legal team told him to take it down, he did as he was told, but he also sent letters to lawmakers and other stakeholders, raising red flags in every direction. That includes letters sent today to the Federal Trade Commission and to Microsoft’s board of directors, CNBC reported.
In Jones’ letter to FTC Chair Lina Khan, Jones said that Microsoft and OpenAI have been aware of these issues since at least October and will “continue to market the product to ‘Anyone. Anywhere. Any Device'” unless the FTC intervenes.
Bloomberg also reviewed Jones’ letter and reported that Jones told the FTC that while Copilot Designer is currently marketed as safe for kids, it’s randomly generating an “inappropriate, sexually objectified image of a woman in some of the pictures it creates.” And it can also be used to generate “harmful content in a variety of other categories, including: political bias, underage drinking and drug use, misuse of corporate trademarks and copyrights, conspiracy theories, and religion to name a few.”
