Korean Police Suspend AI Legal Tool Over Cost and Accuracy Concerns
SEOUL, Oct. 21 (Korea Bizwire) — South Korea’s National Police Agency has suspended its use of a domestic artificial intelligence–based legal information platform, citing cost pressures and growing concerns over the reliability of AI-generated content after a recent controversy involving ChatGPT-created false legal citations.
According to police officials on Tuesday, the agency announced on its internal bulletin board that free access to LBox AI, a legal document–generation platform, would be discontinued starting the same day.
The system had been available to officers since last year under a free trial agreement with the service provider, but the transition to a paid plan requiring more than 1 billion won (about US$730,000) annually prompted the agency to end participation.
LBox AI allows users to draft legal documents using generative AI technology. Some investigators reportedly relied on it to prepare case reports and other materials. A senior officer acknowledged the benefits but also voiced concern, saying, “If used without proper verification, AI tools could produce inaccurate reports.”
The issue came under public scrutiny during a recent parliamentary audit when Democratic Party lawmaker Kwon Chil-seung revealed that a police non-prosecution report from the Yongin Dongbu Police Station contained a fabricated legal precedent generated by ChatGPT.
“The cited legal principle does not exist in any ruling,” Kwon said, warning that AI hallucinations could distort justice. Acting Commissioner General Yoo Jae-sung confirmed the incident and said that after learning of it, the agency issued formal guidelines cautioning against unverified AI use.
Despite the suspension, the police are exploring controlled ways to integrate AI in legal research. The agency is reportedly negotiating a new contract to enable limited generative AI searches within its law and precedent databases.
Experts stress the need for stronger safeguards. Lee Yoon-ho, professor emeritus of police administration at Dongguk University, said AI can serve as a valuable reference tool but “should never replace human judgment, especially in law enforcement where factual accuracy is paramount.”
M. H. Lee (mhlee@koreabizwire.com)
