On Wednesday, the world was a bit perplexed by the Grok LLM’s sudden insistence on turning practically every response toward the topic of alleged “white genocide” in South Africa. xAI now says that odd behavior was the result of “an unauthorized modification” to the Grok system prompt—the core set of directions for how the LLM should behave.
That prompt modification “directed Grok to provide a specific response on a political topic” and “violated xAI’s internal policies and core values,” xAI wrote on social media. The code review process in place for such changes was “circumvented in this incident,” it continued, without providing further details on how such circumvention could occur.
To prevent similar problems from happening in the future, xAI says it has now implemented “additional checks and measures to ensure that xAI employees can’t modify the prompt without review” as well as putting in place “a 24/7 monitoring team” to respond to any widespread issues with Grok’s responses.
The company’s public statement provides no information on which employee (or employees) were involved in the prompt change, nor how exactly they were able to get such unfettered (and initially unnoticed) access to Grok’s core behaviors. xAI owner Elon Musk has long been a public proponent of discredited theories regarding the killing of white farmers in South Africa and has publicly sold Grok as “maximally truth-seeking AI, even if that truth is sometimes at odds with what is politically correct.”
xAI has not responded to a request for additional comment from Ars Technica.
Just doing what you told me to
To further “strengthen your trust in Grok as a truth-seeking AI,” xAI has also published Grok’s system prompt on Github for the first time, allowing the public to “review… and give feedback” on any future prompt changes.
Though versions of the Grok system prompt have leaked in the past, this first official look under the hood shows some interesting insights into the system’s inner workings. Grok is specifically pushed to “provide the shortest answer you can” unless otherwise instructed, for instance, which is perhaps fitting for an LLM running on a length-limited social network.
