Mystery Agent · Financial services
We send an AI agent through five customer tasks on your website and score what it receives.
Mystery shopping has been standard practice in financial services for forty years. Mystery Agent applies the same discipline to the customer that increasingly does the shopping. Five ordinary tasks at every institution, on public pages, logged out, reading exactly what each site delivers.
Two studies · 50 institution runs · 250 tasks · August 2026
50Institution runs
250Customer tasks attempted
37/50Deliver a complete disclosure
0Applications submitted
Summary
- Product terms are widely published. Prices, fee schedules, rewards rates and APR ranges reach an AI agent as plain text at most institutions.
- Live rate values are the most common item to arrive after scripts run, so an agent often reads the rate page without the rate.
- Application pages are where the whole field converges, and that is the page closest to a customer decision.
- Every gap found here is a publishing decision rather than a content decision, so the content already exists on the institution's own website.
The report
Mystery Agent, 22 pages.
Every exhibit from both studies, three institution pages read frame by frame, an appendix carrying every score, and the method in full. Free to open, and quotation with attribution is welcome.
The two studies
Each study runs the same five task structure against a roster built for that product line.
Deposits
57
Field average across 25 banks, fintechs and credit unions. Led by State Employees' Credit Union at 89. Savings rate, checking comparison, fee schedule, routing number, application page.
Credit cards
65
Field average across 25 issuers, fintechs and credit unions. Led by Bilt Rewards at 82. Purchase APR, card comparison, pricing and terms, welcome offer, application page.
How it works
5
Tasks per institution, each scored out of 100 on completion, answer quality and how directly the answer was reached. The agent reads what each page states and enters nothing.
Highest scores, deposits
See the full deposits leaderboard
Highest scores, credit cards
See the full credit cards leaderboard
The answer a customer receives starts with what your page hands over.
Mystery Agent, August 2026, runs to 22 pages and is free to open.
Download the PDF
Related research
Mystery Agent sits alongside AI Compass, which scores the same delivered content for readability, and the Trust Transfer Index, which measures what AI assistants tell customers about card products. Together they cover what agents can read, what agents say, and what agents can complete.