Application Reports

Comprehensive legal technology platform providing advanced research, document analysis, and case management solutions for legal professionals

Vals Logo

CoCounsel

LAST UPDATED: 2/27/2025

VendorThomson Reuters
FoundedAcquired Casetext in 2023
VLAIR Evaluation4 tasks evaluated

CoCounsel draws upon multiple LLMs, including the GPT and Gemini series, and was notable in the VLAIR study for consistency in its quality of responses. The platform achieved the highest average score across evaluated tasks at 79.5%, ranking first in Document Summarization and surpassing the lawyer baseline in three out of four tasks.


Performance Summary

CoCounsel was evaluated across 4 tasks in the VLAIR benchmark, with scores ranging from 73.2% to 89.6%.

Document Q&A
About This Task
Evaluates answering questions about documents by extracting and synthesizing information for legal research.
CoCounsel
89.6% ± 3.5
Lawyer baseline
70.1% ± 5.2
Avg accuracy of all competitors
80.2%
Chronology Generation
About This Task
Creates accurate timelines of events from legal documents for case preparation.
CoCounsel
78% ± 3.8
Lawyer baseline
80.2% ± 3.6
Avg accuracy of all competitors
76.3%
Document Summarization
About This Task
Summarizes documents or specific parts to identify key information in legal workflows.
CoCounsel
77.2% ± 3
Lawyer baseline
50.3% ± 3.6
Avg accuracy of all competitors
64.2%
Data Extraction
About This Task
Extracts specific information, clauses, or data points from legal documents.
CoCounsel
73.2% ± 3.1
Lawyer baseline
71.1% ± 3.2
Avg accuracy of all competitors
70.5%

CoCounsel demonstrated strong, consistent performance across all evaluated tasks, achieving the top score for Document Summarization (77.2%) and surpassing the lawyer baseline in 3 of 4 tasks with sub-60 second response times that deliver immediate productivity gains.


Key Strengths

Based on VLAIR evaluation results, CoCounsel demonstrates several notable capabilities:

  1. Document summarization leadership: Achieved the highest score in the study at 77.2% with a 26.9pp margin above baseline, demonstrating exceptional capability in condensing complex legal documents while maintaining comprehensive accuracy.

  2. Highest average performance: 79.5% average across the four evaluated tasks represents the highest overall score in the study, reflecting consistently strong performance across diverse legal workflows.

  3. Strong Document Q&A: Achieved 89.6% (19.5pp above baseline) showcasing sophisticated document analysis with exceptionally high accuracy, the third-highest score overall in the study.

  4. Multi-document extraction excellence: On the complex extraction task requiring 40 fields across 3 credit agreements, CoCounsel scored 61.7%, significantly outperforming all other tools and demonstrating advanced handling of sophisticated extraction scenarios.

  5. Speed advantage: Sub-minute response times across all four tasks enable immediate productivity gains and support iterative workflows where outputs serve as starting points for refinement.

  6. Balanced response style: Medium-length responses achieve high accuracy without excessive verbosity, striking an optimal balance between comprehensiveness and conciseness that suits professional workflows.

  7. Dual-layer citation system: Unique approach combines synthesized explanations in main text with exact source quotes in footnotes, providing both accessibility and precision for legal professionals who need both clarity and verification.

  8. Thomson Reuters ecosystem integration: Seamless integration with Westlaw, Practical Law, and other TR products creates unified workflows for existing customers, though full capabilities require separate licenses for CoCounsel Core, CoCounsel Drafting, Westlaw Precision, and Practical Law Dynamic.


Based on the Vals Legal AI Report (VLAIR), February 2025 - First independent benchmarking study of legal AI tools using real legal work from Am Law 100 law firms.