The rise of large language models (LLMs) has sparked questions about their computational abilities compared to traditional models. While recent research has shown that LLMs can simulate a universal Turing machine by using an external memory through prompting, this setup often relies on external controls, which shift much of the computational load away from the LLM itself. Until now, it has remained an open question whether an LLM, unaided by such external