The Audit Trail Is the Liability: What AI Legal-Research Errors Mean for Tenant-Rep Brokers

Stanford RegLab ran a preregistered evaluation, meaning the test design was locked before the results came in, against three commercial AI legal research products: Lexis+ AI, Westlaw AI-Assisted Research, and Ask Practical Law AI. All three are marketed as eliminating hallucination risk. The study found each tool hallucinated between 17% and 33% of the time. Accuracy came in at 65% for Lexis+ AI, 41-42% for Westlaw AI-Assisted Research, and 19% for Ask Practical Law AI (Stanford RegLab, arXiv 2405.20362).

Worth flagging directly: the paper's authors disclose that one of them advises language-model companies, and Stanford said it would augment the study after some parties questioned the results. That's a live caveat, not a settled number. But even a generous discount off a 19-65% accuracy spread doesn't get you to a place where an unverified AI output belongs in a signed lease negotiation.

Because the failure mode isn't legal-specific. It's structural. A tool marketed as reliable that is actually unreliable creates a documentation problem before it creates an accuracy problem. If a broker uses an AI tool to pull a rent comp, model an escalation clause, or flag a lease-expiry date, and the tool is wrong 20-30% of the time while claiming near-zero error, the broker now has two exposures instead of one: the underlying mistake, and the fact that they trusted a system whose own accuracy claims don't hold up.

One Seattle-adjacent broker on Reddit put it plainly: telling a client "the AI said so" makes the negligence case stronger, not weaker, because "no idiot would leave a contractual obligation to AI without manually verifying when there are dollars on the table" (r/CommercialRealEstate, cited in BrokerHQ's own sourced data). A second broker on the same thread reached the identical conclusion independently: "no sane person leaves a $1M obligation to a black-box AI. Verification is the only way to kill negligence." Two brokers, two separate posts, same structural read. That's not one anxious outlier, that's a pattern.

BrokerHQ's own sourced data tracks AI liability risk as an active complaint theme: 9 logged complaints as of September 7, 2026, ranked 8th out of 102 tracked themes by frequency, first observed June 15, 2026. The pattern shows up across 2 independent platforms, meaning it's not confined to a single forum's echo chamber. Intensity is tagged high across every quote tied to the theme.

What's not yet knowable from this data: whether frequency is rising, flat, or falling. The measurement window doesn't have four weeks of trailing history stored yet, so there's no trend line, only a current snapshot. Treat the 9-complaint count as a real, sourced number and the absence of a trend as an honest gap, not a hidden one.

A third broker, discussing AI use in CRE modeling more broadly, framed the real risk correctly: "The biggest risk I'd watch is less 'can AI build the model?' and more 'can someone else audit the assumptions quickly?'" (r/CommercialRealEstate, cited in BrokerHQ's own sourced data). That's the operative distinction. A model that's fast and internally consistent but opaque to a second reviewer, a lender, an equity partner, a client's attorney, doesn't reduce your liability. It just moves the liability into a black box with your name on the transmittal.

Auditability means someone other than the broker who ran the tool can trace an output back to its inputs in minutes, not hours. If a rent comp, an escalation calc, or a lease-abstraction result can't be walked back to a verifiable source in front of a client, it's not ready to go in a deal memo.

Fair challenge. The honest version of the counter-case: hallucination rates in general-purpose legal AI tools don't automatically transfer to narrower CRE use cases like pulling a public rent comp or summarizing a lease clause, where the task is more constrained and the ground truth is easier to check. It's also true that human brokers make errors too, and no one's holding manual comp-pulling to a 100% accuracy bar. The Stanford numbers are specific to legal research tools tested against legal-research tasks; extrapolating a 19-33% hallucination rate onto every AI use case in CRE is a stretch the study itself doesn't make.

What doesn't survive the counter-case: the marketing gap. The Stanford study's most damaging finding wasn't the error rate, it was that vendors claimed "hallucination-free" performance while the tools hallucinated on a quarter of queries. That gap between claim and behavior is the liability, independent of whether the underlying task is narrow or broad. A broker who can show they verified an AI output manually has a defense. A broker who can show only that a vendor promised accuracy has a plaintiff's exhibit.

BrokerHQ's view: this isn't an argument against using AI in tenant-rep work. It's an argument against using it without a receipt. If a broker can't show, in under five minutes, exactly where a rent comp or lease-abstraction number came from, that broker has taken on a liability the vendor's marketing copy didn't disclose. The fix isn't avoiding AI tools, it's refusing to let any AI output into a client-facing deliverable without a traceable source attached. That's the standard BrokerHQ builds to, and it's the standard we'd tell any broker to hold a vendor to before trusting a black-box number with a client's signature on the line.