I had a realization recently. These things are like the reverse of the mythical Cassandra: no one can ever be sure that their information is correct, but everyone trusts what they say.
Legal questions are very case sensitive, no pun intended. It’s like asking an extremely specific programming implementation question. LLMs don’t do very well with those types of prompts because the narrower the focus, the less of its training data applies to it and the more likely it’ll just straight up hallucinate. And they don’t yet have the nuance necessary to determine that an area of case law may not be settled and is in a legal grey area.
news.bloomberglaw.com
Active