The eSafety Commissioner is sounding the alarm over the use of the generative artificial intelligence system known as Grok on the social media platform X, following concerns that the tool is being used to create sexualised or exploitative images of people.
While the volume of reports remains low, officials have noted a worrying shift from almost no complaints to several over the past two weeks. The regulator has made it clear that it is prepared to use its legal powers, including the issuance of removal notices, whenever content crosses the thresholds set out in the Online Safety Act.
Local families and schools in our suburbs should be aware that X and other similar services are already bound by systemic safety obligations.
These rules require companies to detect and remove child sexual exploitation material and other unlawful content under Australia’s industry codes. In response to the recent trend, the commissioner has written directly to X to demand more information on what safeguards are actually in place to stop Grok from being misused.
This move follows a significant crackdown earlier in twenty twenty five when enforcement action forced several popular nudify services to withdraw from Australia after they were used to target school children.
Stricter rules are on the horizon for these technology giants. New mandatory codes are set to begin on nine March twenty twenty six, which will force artificial intelligence services to limit the access children have to sexually explicit or violent material.
These upcoming regulations also target content related to self harm and suicide. For now, the government expects all platforms to meet basic online safety expectations by taking proactive steps to stop harmful activity before it spreads.
The scrutiny on X is not new, as the company has previously been hit with transparency notices regarding its handling of child abuse material and its use of generative AI features. Australian authorities are currently working with international child protection groups who have seen similar patterns of misuse involving Grok and other high tech tools globally.
These developments serve as a reminder for parents in our community to stay vigilant, as the push for safety by design becomes a central battleground in the fight to protect children from emerging digital threats.
