Trouble with Microsoft's New AI Tool: Concerns Raised by Employee

Shane Jones, an engineer at Microsoft, wasn’t pleased with what he saw on his computer screen. He was trying out Copilot Designer, a new AI image generator launched by Microsoft in March 2023.

Powered by OpenAI’s technology, the tool allows users to create images by entering text prompts. But Jones noticed some disturbing images being generated, including demons, violent scenes, and even underage drinking and drug use.

In addition to concerns about violence and harmful content, there are also serious copyright issues involved. The Copilot Ai tool also generates images that features copyrighted characters from Disney, like Elsa from “Frozen,” Snow White, Mickey Mouse, and Star Wars characters.

These images potentially violate both copyright laws and Microsoft’s policies with images like an Elsa branded handgun and Star Wars branded Bud Light cans, along with Snow White’s likeness on a vape.

Trouble with Microsoft's New AI Tool: Concerns Raised by Employee

Furthermore, the tool has been creating controversial images, such as Elsa depicted in the Gaza Strip amidst ruins and “free Gaza” signs, holding a Palestinian flag.

Additionally, there are images of Elsa wearing the military uniform of the Israel Defense Forces and holding a shield with Israel’s flag. Jones emphasized that this issue goes beyond copyright concerns and indicates a broader problem with the tool’s safeguards.

Despite raising his concerns internally, Microsoft didn’t take the product off the market. So Jones took matters into his own hands, writing letters to the Federal Trade Commission and Microsoft’s board of directors, urging them to address the issues. He’s worried that the tool could spread harmful content globally, and believes there should be better safeguards in place.