Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools

6 jruohonen 4 4/27/2025, 8:06:14 PM onlinelibrary.wiley.com ↗

Comments (4)

jruohonen · 4d ago
It doesn't really seem that the situation would be improving or could be even solved:

"While hallucinations are reduced relative to general-purpose chatbots (GPT-4), we find that the AI research tools made by LexisNexis (Lexis+ AI) and Thomson Reuters (Westlaw AI-Assisted Research and Ask Practical Law AI) each hallucinate between 17% and 33% of the time."

Ref.:

https://news.ycombinator.com/item?id=43814663

techpineapple · 4d ago
Is there indexable database of references you could compare hallucinations against? How does perplexity provide reliable references
jruohonen · 4d ago
Yes: there are databases.

However, as also elaborated in the paper, the issue is not merely about providing wrong (including nonexistent) references but also about factual correctness of the references or not giving references when needed.

I don't know whether these and other aspects of Perplexity's (or CoPilot's) references have been evaluated.

farm42 · 3d ago
Here are 5 annoying PDF problems that AI PDF Summary solves — and Adobe doesn’t

Too long, didn’t read (TLDR): Academic papers, reports, contracts... 50+ pages of fluff. → AI PDF Summary gives you a clean, accurate TL;DR in seconds. No search, no context: Adobe lets you search, but doesn’t explain. → We go further: semantic summaries, not just keywords. Reference chaos: Hunting for useful sources in a mess of citations? → AI PDF Summary extracts and formats the 5 most important references — like a research assistant with a PhD. Manual note-taking madness: Highlight-copy-paste-repeat. Again and again. → Our tool gives you structured notes automatically, broken into sections. No language support: Most tools focus on English only. → AI PDF Summary works in multiple languages, context-aware. Built by researchers, for researchers. Perfect for students, scholars, analysts, and anyone who’s PDF-fatigued.

No bloat. No clutter. Just instant clarity.

#AIPDFSummary #PDFtools #ProductivityTools #AcademicLife #AIforResearch #GPTpowered #EdTech #KnowledgeWork #AdobeAlternative #ResearchMadeEasy #TLDR