Why using a chatbot as your lawyer is a risky move – and ties up our court system

Detailed summary
Self-represented litigants are increasingly using AI in their court cases. It’s a huge risk and a burden on the court system.
In the Federal Court of Australia, applications by self-represented litigants, many using artificial intelligence (AI) to research and draft their claims, have skyrocketed.
The Fair Work Commission, a federal tribunal, has already seen a jump in filings, many of them “AI slop”.
These experiences are also reflected in our centre’s global database of AI-related cases. It contains 295 Australian cases (to September 30 2026) in which a court or tribunal identified problematic use of AI in legal proceedings. Examples include citing made-up case law, citing law that is real but irrelevant to the case, and using AI to write witness statements or submissions that aren’t entirely accurate.
The database shows a huge increase in cases where these types of AI misuse has been mentioned over the past year, with self-represented litigants accounting for 81% of Australian misuse cases.
Access to courts is a fundamental part of access to justice. But starting court proceedings without a viable or valid claim wastes time, causes stress and may have severe financial consequences for the person bringing the case.
People might use chatbots built on large language models to help them with a legal matter in different ways:
While AI might usefully assist people to do all of these things, generative AI chatbots are much more sycophantic than humans.
Lawyers have a duty to always act in their clients’ best interests, which sometimes means challenging clients’ views and delivering unpopular opinions. AI chatbots have no such obligations.
There may also be errors in the material that they generate. For example, in Sadnan Khan v Aldi Pty Ltd, the Fair Work Commission took the unusual step of ordering costs of A$1,230 against a former Aldi employee who tried to sue for unfair dismissal. The commission found Khan had relied on AI-generated arguments even though he should have realised his claim was doomed to fail. (Leave to appeal was refused).
Opening of the article, excerpted from The Conversation AU. To read the rest, open the article on the publisher's site.
MarketNews shows the headline and summary published by the outlet. The full article is on the publisher's website. (theconversation.com)

