GenAI Accuracy
If We Achieve Legal AI Perfection – Everything Changes
Lawyers want genAI tools to give good results. But, what happens when they become almost perfect, i.e. 99.9% accurate, all of the time? That would …
GenAI Accuracy
GenAI Accuracy
‘Missed-MFN-Gate’ and AI Contract Review
An analysis of the VALs genAI benchmarking study by Noah Waisberg, CEO, Zuva. Artificial intelligence tools for contract review have made real progress in recent …
GenAI Accuracy
vLex + Vecflow Comment on Vals AI Study Results
vLex and startup Vecflow, which were among the companies in the Vals genAI performance study (see here), have sent Artificial Lawyer some comments on the …
GenAI Accuracy
Vals Publishes Results of First Legal AI Benchmark Study
Vals AI, the US-based company providing genAI performance testing, has published its first study of how several legal tech companies responded to a series of …
GenAI Accuracy
AgentEval Launches Open-Source AI Benchmarking Initiative
AgentEval is a new initiative to provide the legal market with an open-source collection of genAI benchmarks that can be freely used, and also is …
GenAI Accuracy
Screens Publishes Redlining GenAI Accuracy
As the movement to bring more transparency and understanding to legal genAI accuracy grows, US-based Screens has published another in-depth performance study, this time on …
GenAI Accuracy
Canada Prof Blasts Lexis+ AI, LexisNexis Fires Back
Here we go again. An academic blasts a legal AI tool for not working as expected and the legal tech company moves to defend itself. …
GenAI Accuracy
Harvey Launches Legal GenAI Evaluation System: BigLaw Bench
Harvey has publicly launched BigLaw Bench, their own methodology for evaluating the accuracy of genAI tools when used on legal tasks, measuring ‘what % of …
GenAI Accuracy
GenAI Benchmarks Initiative – Key Points From First Meeting
Last week, the first meeting of the genAI Benchmarks Initiative took place at the London office of CMS. Its goal: to scope out a path …
GenAI Accuracy
Wolters Kluwer’s Human Solution to GenAI Inaccuracy
Wolters Kluwer in Australia has a novel solution to genAI hallucinations and errors: don’t entirely trust it on its own. Instead, the company is providing …