NewMissing Records Detection: flags every visit, provider, and date missing from the file. See how →
Home › Reports › All the issues courts have found with AI-assisted work product (and what they mean for experts)
State of AI for medical expert witnesses, 2026

All the issues courts have found with AI-assisted work product (and what they mean for experts)

What goes wrong with AI record review tools for the medical expert witness, according to the people who reviewed them: 30 vendors name medical expert witnesses on their own commercial pages, 19 of them say the output cites back to the source page, and 12 publish a price you can act on without a sales call.

By Ahmed Jemaa · Medrecords AI · 2026-09-07 · Audience: Medical expert witnesses
At a glance
30Vendors counted
191Sources linked
1094Pages captured
172Reviews coded
On this page
  1. At a glance
  2. The article
  3. Methodology
  4. Sources
  5. Frequently asked
  6. More in this series
  7. How Medrecords AI does this work
  8. Explore the content hub
  9. Test on a file

The article

What goes wrong with AI record review tools for the medical expert witness, according to the people who reviewed them?

What the data says
  • 30 vendors name medical expert witnesses on their own commercial pages. 19 of them say the output cites back to the source page.
  • 12 of 30 publish a price a buyer can act on without a sales call.
  • Of 74 public reviews of AI vendors in this category, 2 mention accuracy or error at all.
2 of 74
reviews of AI vendors mention accuracy or error at all
174-review corpus
2 of 74
mention citations or source links
captured 2026-08-13
33 of 74
mention support
the loudest theme
62 of 63
one-star reviews are of services, not software
retrieval and examination firms

The finding that should worry every buyer

Of 74 public reviews of AI and software vendors in this category, 2 mention accuracy or error at all, and 2 mention citations or source links. 0 mention hallucination.

Support is mentioned 33 times and speed 32 times. The public voice of this market is about price, speed and service. It is almost silent on whether the output is right.

Read that as a warning about the reviews, not a clean bill of health for the software. Buyers write reviews about what they can see. Turnaround time is visible on day one. A missed record inside a two-thousand-page file is not visible until someone gets cross-examined about it.

What buyers of AI record-review products actually write about

coded themes across 74 reviews of AI and software vendors

Output called accurate15Support praised10Speed praised7Turnaround too slow4Human check still needed4A record was missed4Price complaint3Duplicates not handled3Hard to learn1AI feature called immature1cautious_adoption1ai_resistance1

One review can carry more than one theme. Themes were coded by regex sweep, then every quoted row was read and verified by hand.

What the negative reviews are actually about

62 of the 63 one-star reviews in this corpus are of records-retrieval firms and independent examination companies, not of software. They complain about slow turnaround, wrong records, unwanted follow-up contact, and examiner impartiality.

Exactly one one-star review covers a software product. It complains about cost, support and the contract, and it calls the AI feature barely usable rather than inaccurate. Nobody in this corpus writes a one-star review that says the summary was wrong.

What the same buyers write in public forums

coded themes across 30 Reddit threads

Turnaround too slow12Privacy or data concern9Output called accurate8Price complaint5Speed praised4Duplicates not handled4A record was missed3Support praised3Support criticised3Output invented a fact2Unwanted follow-up contact2Human check still needed1citation_need1context_limit1Examiner accused of bias1

Price appears in 22 of 30 threads. Hallucination appears in 2.

The quotes worth reading

These are the reviews where a buyer names a real limit. Several sit inside five-star reviews, which is the point: the people who like these products best are also the people describing what they still have to check.

VendorStarsExcerptWhy it matters
Supio5"when you ask a follow-up question, it may acknowledge that it missed something significant"From a five-star review. The praise and the limitation sit in the same sentence.
Supio5"Handwritten notes tucked into medical records can get missed from time to time"Same reviewer calls the product a starting point rather than a finished answer.
EvenUp5"it's always good to double-check the demands received"Five-star review. The reviewer frames verification as routine, not as a defect.
EvenUp5"identifying the pros I missed and, often most importantly, the traps"
Filevine1"barely usable and not ready for prime time"The reviewer says they threatened arbitration to exit the AI product. The only openly negative account of an AI feature in the whole review corpus.
Filevine4.5"cautiously exploring their AI tool, Lois, to see how well it will work"
Filevine5"take a couple of days for us is now completed in around 2 hours"
CaseFleet5"its transcription could be better for audio files"
CaseFleet"we have control over reviewing and creating a chronology vs other software"A legal nurse consultant testimonial published by the vendor itself, positioning the product as the choice that does not use AI.
Ontellus1"they did not even send out the subpoenas to the medical providers as requested"
Compex Legal Services1"asking for the same records that have been sent on time"
ChartSquad1"They took so long to get records that I did not need them anymore"
Dane Street1"Mouthpiece for the insurance companies they contract with to review appealed claims"
Dane Street1"The person that did my evaluation apparently did not read my medical records"
ExamWorks1"the appointment would take 1-2 hours. I was seen for 17 minutes"
US Legal Support1"we did not receive rough transcripts until AFTER out trial date"

One excerpt per review, under fifteen words, linked to the review it came from. 16 reviews were read and verified by hand. Everything else is paraphrased and aggregated into the coded themes above.

What the same buyers say when nobody is asking for a review

Reddit is where the unfiltered version lives. It is also where hallucination finally gets named, though only twice in thirty threads.

ThreadDateExcerptWhy it matters
r/legaltech2026-01-27"maintaining consistency, traceability, and contradiction detection across large multi-source records"
r/legaltech2026-01-27"work well up to maybe 200 pages, after that the context gets too long"Posted by an account named qme_docs, which also names MedChron, InPractice and DodonAI.
r/LawFirm2025-01-21"Usual caveats about hallucinations though"Said while recommending DigitalOwl. Hallucination is treated as an accepted cost, not a disqualifier.
r/WorkersComp"the ime just made up non existing symptoms and evidence"A claimant describing a human examiner, not an AI tool. The vocabulary of hallucination predates the software.

4 excerpts from the 30 threads, each linked to its thread.

How to test for each of these yourself

  • Missed records. Put a file through with one known visit removed. See whether the tool says anything is missing, or silently summarises what it was given.
  • Duplicates. Include the same discharge summary three times under different scan dates. Check whether you are billed once or three times.
  • Handwriting. Include two pages of handwritten nurse notes. Read what came back against what is on the page.
  • Citations. Take five statements from the output at random and click through. If any one of them does not resolve to a page, the citation feature is decorative.
  • Contradiction. Include two notes that disagree about a date of injury. See whether the tool flags the conflict or picks one and moves on.

Every one of these tests takes under an hour and none of them needs the vendor's help. Run them before the contract, not after.

Methodology

This is a secondary-research study, not a survey. Every number is a count over a named set of vendors, taken from what those vendors publish on their own sites, with a source URL and a capture date.

This article
30vendors counted
5677coded evidence rows
1094pages captured
172reviews coded

What we did

  1. We built a vendor pool from two owned corpora: a 55-site competitor scrape captured on 2026-08-13, and 328 live company profiles from the Medrecords AI content hub.
  2. We ran four targeted discovery passes for the audiences the pool covered thinly: legal nurse consultants, medical expert witnesses, life care planners, and California QMEs. Those passes added 36 vendors that name those buyers on their own commercial pages.
  3. We coded a fixed rubric against every page we hold. A rubric field is marked yes only when the vendor's own copy says it, and each yes carries the page URL, the capture date, and a verbatim excerpt of fifteen words or fewer.
  4. We pulled each vendor's sitemap, llms.txt, and robots.txt live on 2026-09-06 and 2026-09-07 to measure how often the site changes and whether it invites or blocks AI crawlers.
  5. We pulled Wayback Machine snapshots near 1 September of 2024, 2025, and 2026 and counted seven marketing terms in each, to show how the category's own language moved.
  6. We read 174 third-party reviews and 30 Reddit threads and coded them into themes. Only hand-verified quotes are published.
  7. We scored each vendor for each audience on six weighted components and published the component scores next to the total, so a reader can disagree with a weight and re-rank.

How a claim is scored

Each rubric field is scored from the vendor's own pages, never from a press release or a third-party listing. Strength records where the claim appears, because a claim on a pricing page is worth more than a claim in a blog post.

StrengthWhat it means
strongStated at least twice on a key page, or at least four times across the site. Key pages are the homepage, product, pricing, security, solutions, platform, features, integrations, trust, compliance, and about pages.
mediumStated once on a key page, or at least twice elsewhere.
weakOne passing mention anywhere on the site.

Capture dates

WhatWhen
Competitor site scrape2026-08-13
Content hub profiles2026-09-01
Reviews and reddit2026-08-13
Discovery passes2026-09-06
Sitemap llms robots pull2026-09-06 to 2026-09-07
Wayback targets2024-09-01, 2025-09-01, 2026-09-01
Rankings computed2026-09-07

Limitations

  • This measures what vendors publish, not what their software does. A vendor that cites to the source page but never says so scores low here. That is the method working as intended: the study is about the public record, and a buyer reading a website sees the same thing.
  • Coverage is uneven by design. Fifty-five vendors have a deep page-level scrape. Thirty-five more were found by targeted discovery and scraped shallowly. The rest appear in the pool for completeness and are never ranked.
  • Update velocity can only be measured where a sitemap publishes lastmod dates. 60 vendors do. For the others the field is recorded as not measured, never as zero.
  • Wayback coverage is thin. The Internet Archive holds snapshots near all three target dates for 35 of the 55 deep-corpus vendors. Term trends drawn from that subset are directional and are labeled as such wherever they appear.
  • Review counts favor vendors that sell to law firms, because those are the vendors with public review profiles. A physician-facing product with no G2 listing is not worse, it is unlisted.
  • Prices are list prices published on a pricing page. Negotiated and enterprise pricing is invisible to this method, and most enterprise vendors publish no price at all.
  • Every count is a count over this vendor set on these dates. It is not a market share estimate and it is not a projection.

Gates we skipped and tools we could not use

  • openseo organic metrics. Dataset-build step 13 is optional and costs credits. It was not run, because a batch over 2,000 credits needs founder approval and none was given. No organic-traffic or keyword figure appears anywhere in this study.
  • Full six-page scrape of discovery vendors. Dataset-build step 7 was completed for the 55 deep-corpus vendors and only partly for the 35 discovery vendors. Those vendors carry audience, pricing, and citation evidence from the pages actually fetched, and are marked discovery_pass so a reader can see the difference.
  • LibreOffice recalculation. The source checklist is an xlsx workbook. LibreOffice is not installed on the build machine, so the workbook was read with openpyxl and never recalculated. No figure in this study comes from a workbook formula.
  • Reddit direct access. Reddit blocks direct fetching from this machine. The 30 threads were captured through a third-party scraping API on 2026-08-13 and are quoted only where hand-verified.
  • Regulatory text verification. Statutory and regulatory citations marked verify in the source checklist have not been checked against current text. None of them is used as a number in this study.
  • Wayback CDX queries rate-limit hard under parallel load. The first pass lost 28 vendors to connection refusals. Those were retried serially with four-second spacing, which recovered most of them. The count above (122 snapshots) is what actually returned, not what was requested.
  • Exactly 5 vendor in the pool blocks AI crawlers in robots.txt: mosmedicalrecordreview.com, ecsper.com, provalens.ai, doqtor.io, smartmd.com.

Composites

Where this study describes a buyer situation rather than a vendor claim, it is a composite drawn from published sources, not a survey. Composites are labeled at the point of use with the number of sources behind them. No customer, prospect, or call participant is identified.

Review quotes are one excerpt per review, under fifteen words, in straight quotes, linked to the review. Everything else is paraphrased and aggregated into coded themes.

Every table and chart in this series links to the page it came from. Where a page has changed since capture, the capture date printed next to the figure is the date that matters. Wayback links are given for figures drawn from archived snapshots.

Sources

191 sources. Every figure in this article traces to one of them. External links are marked nofollow and open in a new tab. Earnings call transcripts sit in our own corpus and carry no public link, so they are listed by company and quarter for anyone who wants to pull the original.

Vendor pages that name medical expert witnesses (30)

Pricing pages (12)

Funding, acquisition and product announcements (16)

Earnings call transcripts in the owned corpus (8)

  • ExlService Holdings (EXLS), Q4 2025 earnings call · 2026-02-25
  • Verisk Analytics (VRSK), Q1 2026 earnings call · 2026-04-29
  • CCC Intelligent Solutions (CCC), Q1 2026 earnings call · 2026-04-30
  • Guidewire Software (GWRE), Q3 FY2026 earnings call · 2026-06-04
  • Marsh & McLennan (MMC), Q2 2026 earnings call · 2026-07-21
  • ExlService Holdings (EXLS), Q2 2026 earnings call · 2026-07-29
  • Verisk Analytics (VRSK), Q2 2026 earnings call · 2026-07-29
  • CCC Intelligent Solutions (CCC), Q2 2026 earnings call · 2026-07-30

Court decisions (5)

Internet Archive snapshots (105)

Reviews and threads quoted (15)

Frequently asked

Is this a survey?

No. Nobody was interviewed and nobody filled in a form. Every number is a count over a named set of vendors, taken from what those vendors publish on their own sites, with a source link and a capture date next to it.

How many vendors are behind the numbers on this page?

30. A vendor is counted for medical expert witnesses only when it names that audience on its own commercial pages and carries page-level evidence in this study. The full pool is 364 companies, of which 90 carry that evidence.

What does it mean when a vendor is not counted for a capability?

It means the claim does not appear on any page we captured. It does not mean the software cannot do it. This study measures the public record, which is also what a buyer reading a website sees.

Why do the reviews say so little about accuracy?

Of 74 public reviews of AI and software vendors in this category, 2 mention accuracy or error and 0 mention hallucination. Reviewers write about what they can see. Turnaround is visible immediately. A missed record is not visible until it matters.

Can I check your work?

Yes, and that is the point. Every table links to the page it came from and prints the date we read it. Where a figure comes from an archived snapshot, the snapshot link is in the sources section.

Does Medrecords AI appear in the ranking?

No. We publish this study, so ranking ourselves against our own rubric would not be a ranking. The rubric and every input are public, so anyone can score us on the same sheet.

How Medrecords AI does this work

Medical chronology

A dated, deduplicated timeline with a citation on every entry.

Product

Medical record Q&A

Question the whole record in plain English; every answer cited.

Product

Verifiable AI citations

If it is not cited, it is not said.

Product

Explore the content hub

Software & platforms

AI and case-management platforms across medical-record review.

Service providers & BPOs

Record review, peer review, retrieval, LNC and BPO providers.

State programs

Rules, AMA Guides edition, and MMI standards by state.

Comparisons

Head-to-head vendor and program comparisons.

Guides

Editorial reference on report writing, MMI, and validity testing.

Conferences & events

Workers comp, claims, insurance and medical-legal conferences.

Directories

Link-out rosters of examiners, LNCs, and expert witnesses.

State matrix report

All 10 verified state programs, side by side.
Test it on a real file before you believe any of this.

Medrecords AI processes the record, cites every line, and bills per deduplicated page. The first 500 pages are free to test.

  • Cited output, not a black-box summary
  • Duplicates never billed
  • HIPAA / SOC 2
  • Flat 10¢ per page to start
Test a file → Book a demo