Application Reports

Comprehensive legal technology platform providing advanced research, document analysis, and case management solutions for legal professionals

Vals Logo

Vincent AI

LAST UPDATED: 2/27/2025

VendorvLex
ReleasedOctober 2023
VLAIR Evaluation5 tasks evaluated

Vincent AI is vLex’s legal AI assistant, combining global legal data from vLex with U.S. law from Fastcase. Released in October 2023, the platform achieved scores ranging from 53.6% to 72.7% across five evaluated tasks, surpassing the lawyer baseline in three tasks with exceptionally fast response times and comprehensive, multi-page responses.


Performance Summary

Vincent AI was evaluated across 5 tasks in the VLAIR benchmark, with scores ranging from 53.6% to 72.7%.

Document Q&A
About This Task
Evaluates answering questions about documents by extracting and synthesizing information for legal research.
Vincent AI
72.7% ± 5.1
Lawyer baseline
70.1% ± 5.2
Avg of all participants
80.2%
Data Extraction
About This Task
Extracts specific information, clauses, or data points from legal documents.
Vincent AI
69.2% ± 3.2
Lawyer baseline
71.1% ± 3.2
Avg of all participants
70.5%
Transcript Analysis
About This Task
Analyzes court transcripts, depositions, and hearing records to extract relevant information.
Vincent AI
64.8% ± 6.5
Lawyer baseline
53.7% ± 6.8
Avg of all participants
65.4%
Document Summarization
About This Task
Summarizes documents or specific parts to identify key information in legal workflows.
Vincent AI
58.9% ± 3.5
Lawyer baseline
50.3% ± 3.6
Avg of all participants
64.2%
Redlining
About This Task
Identifies changes, modifications, and amendments in legal documents for contract review.
Vincent AI
53.6% ± 6
Lawyer baseline
79.7% ± 4.8
Avg of all participants
66.1%

Vincent AI demonstrated strong performance in document analysis tasks, surpassing the lawyer baseline in Document Q&A (72.7%), Transcript Analysis (64.8%), and Document Summarization (58.9%) with exceptionally fast response times noted as among the quickest evaluated in the study.


Key Strengths

Based on VLAIR evaluation results, Vincent AI demonstrates several notable capabilities:

  1. Transcript analysis excellence: Strong performance at 64.8% (11.1pp above baseline) with 100% accuracy on complex identification tasks, demonstrating comprehensive information extraction from scanned, messily-formatted court transcripts.

  2. Speed advantage: Among the fastest response times of all evaluated products, enabling immediate productivity gains and supporting iterative workflows where outputs serve as starting points for refinement.

  3. Document Q&A capabilities: Achieved 72.7% (2.6pp above baseline) with thorough, multi-page responses that provide comprehensive context and detailed explanations particularly valuable for users requiring extensive legal guidance.

  4. Adaptive workflow design: System automatically infers appropriate sub-skills based on user questions, adapting to query context and proactively asking follow-up questions when clarification is needed to ensure tailored responses.

  5. International jurisdiction support: Extensive coverage of global legal systems through vLex’s international data repository combined with Fastcase’s U.S. law coverage, providing unique value for firms working across multiple jurisdictions.

  6. Responsible AI approach: Refuses to answer when legal research database lacks sufficient data rather than generating incorrect information, demonstrating commitment to accuracy over appearing to have all answers.

  7. Comprehensive response style: Verbose, detailed responses often extending beyond two pages with structured formatting and bullet points, offering valuable additional context that may prove especially beneficial for junior lawyers.


Based on the Vals Legal AI Report (VLAIR), February 2025 - First independent benchmarking study of legal AI tools using real legal work from Am Law 100 law firms.