European Union regulators have launched a formal inquiry into X over its handling of sexualized Artificial Intelligence images of a child and its broader approach to Artificial Intelligence driven features on the platform. Officials are examining whether X complied with the bloc’s new digital regulations, which impose strict duties on large online platforms to manage systemic risks, protect minors, and respond quickly to reports of illegal or harmful content. The investigation focuses on how sexualized Artificial Intelligence images were generated, circulated and moderated, and whether X had adequate processes in place to detect and address such material before and after users flagged it.
The European Commission is using its powers under the Digital Services Act to request detailed information from X about its Artificial Intelligence systems, content recommendation tools, and safeguards for children. Regulators are assessing whether the company sufficiently evaluated and mitigated the “systemic risks” arising from integrating generative Artificial Intelligence into its service, including the potential for large scale distribution of manipulated images that target minors. Officials are also reviewing how quickly X responded to specific reports about the sexualized Artificial Intelligence images, what internal escalation steps were taken, and whether law enforcement was notified in a timely and appropriate manner.
The outcome of the case could have significant implications for how major platforms deploy Artificial Intelligence features in the European Union and the level of oversight they must apply to prevent misuse. If the commission finds serious or repeated violations of the Digital Services Act, X could face substantial penalties and binding orders to change its systems and policies. The inquiry adds to mounting regulatory pressure on large technology companies over the safety, transparency and governance of Artificial Intelligence tools, and will serve as an early test of how the European Union intends to enforce its new digital rulebook in situations involving vulnerable users and high risk content.
