GenAI Benchmarking
The AI Benchmarking Tightrope: Moving from Good Intentions to Gold Standards
By Jim Wagner, CEO, The Contract Network A ‘Vals 2’ legal AI benchmarking project is planned and it is bound to spark debate. As many …
GenAI Benchmarking
GenAI Benchmarking
Dentons + Bird & Bird Join Swiss GenAI Benchmarking Project
Dentons and Bird & Bird are joining a group of Swiss and other European organisations, including the University of Zurich, to build JuriAIindex, a new …
GenAI Benchmarking
Benchmarking Update + The Need For A GenAI Compass
After in-person and online meetings to develop thinking around how to approach genAI accuracy, the LITIG AI Benchmarking project is now moving to the next …
GenAI Benchmarking
GenAI Benchmarking Project: Virtual Workshop + Next Steps
After a successful meeting over the summer, the project to develop thinking around legal genAI accuracy is moving to the next stage, with a virtual …
GenAI Benchmarking
OC Repeats Harvey Tests, Says Its GPT-4o ‘Surpasses’ It? But Does It Really? – Updated
Christian Braun, an AI engineer in Germany at international firm Osborne Clarke (OC) ran Harvey’s recently highlighted BigLaw Bench tests for genAI accuracy and has …
GenAI Benchmarking
Why We Need Standards For Legal GenAI
Imagine buying a car from a vendor for which there are no standards, nor benchmarks for measuring and understanding: its safety features, its speed, its …
GenAI Benchmarking
LITIG Forms Legal Industry AI Benchmarking Initiative
LITIG, the Legal IT Innovators Group, with support from Artificial Lawyer, has formed a Legal Industry AI Benchmarking Collaboration initiative in order to address the …