xAI, the artificial intelligence company owned by Elon Musk, has filed a lawsuit against Terry Wayne Harwood of South Carolina, alleging he used the Grok chatbot to generate child sexual abuse material (CSAM). The lawsuit claims Harwood intentionally bypassed the system's safeguards to alter non-consensual images and distribute illegal content, breaching the company's policies.
Allegations and User Conduct
Harwood was arrested in February and faces eight felony charges related to the possession and distribution of CSAM. xAI asserts that "at least some" of the images involved in Harwood’s criminal case were generated or altered using Grok. The company claims the defendant abused the tool to convert non-sexual photographs into sexually explicit images without the subjects' consent.
Legal and Financial Demands
The lawsuit states that Harwood’s actions exposed xAI to "significant legal risk and reputational damage." Consequently, the company is asking the court for:
- Reputational and legal damages.
- Reimbursement for expenses incurred defending itself against legal actions filed by victims of the defendant’s conduct.
- A permanent injunction blocking Harwood from creating an account or using Grok.
This legal action follows previous controversies surrounding Grok’s "spicy" mode and image-editing features, which led to a surge in sexualized AI deepfakes. In March, a group of teenagers sued xAI over claims the chatbot generated sexualized images of them as minors. While Musk previously stated that users creating illegal content would face consequences, this appears to be the first time xAI has directly sued a user over deepfakes.
