The concept of AI exploiting legal systems isn't entirely new. Renowned security expert **Bruce Schneier** discussed this in his 2021 essay, "Coming AI Hackers," and elaborated further in his 2022 book, *A Hacker’s Mind*. Now, researchers are providing concrete demonstrations of this emerging threat. A recent study from Germany highlights how highly capable AI systems, specifically large language models (**LLMs**), can be leveraged to identify vulnerabilities within legal texts. According to the researchers: > Legal systems encode the foundations of social order in natural language. Similar to computer systems, the written law can contain vulnerabilities that invite exploitation. Courts absorb most exploits through interpretation, and such vulnerabilities rarely surface in the first place. With highly capable AI systems enabling the discovery of vulnerabilities at unprecedented scale, we believe the latter could change. The study asserts that a substantial number of previously unrecorded vulnerabilities in the German legal system were identified using **LLMs**. The researchers responsibly shared only those vulnerabilities whose exploitation would not cause serious harm, along with potential exploits for each. This development suggests a future where the accessibility of cheap legal reasoning, powered by AI, could significantly challenge the current functioning of legal systems. The researchers posit that lawmakers may need to drastically enhance the legislative process, potentially by incorporating advanced AI themselves, to harden laws against such sophisticated exploitation. While still in its nascent stages, the idea of AI 'hacking' legal systems is a development that IT security professionals and privacy-conscious users should closely monitor. It underscores the profound impact AI is poised to have across all sectors, including the very foundations of societal order.