# Asked the same question twice, the models moved their own first choice 68% of the time. The leader still held in 7 of 10 categories.

Finance AI Recommendation Index, September 2026 Edition. Page: https://finance-ai-index.com/research/repeat-measurement/

Ten categories were asked again one days after the edition run, with nothing changed: the same prompts, the same model versions, the same settings, one buyer segment, six framings, twelve models, 720 answers. Whatever differs between the two runs is noise, and the noise is what this page measures. That is the reason the index asks every question six ways of every model rather than once: on its own, one ask moved 68% of the time; seventy-two, read together, are what the index reports.

## Model by model

- Qwen 3.7 Flash: 90% of 48 pairs flipped
- MiniMax M2.5: 80% of 40 pairs flipped
- Kimi K2: 77% of 47 pairs flipped
- Llama 4 Maverick: 72% of 32 pairs flipped
- GLM 4.7 FlashX: 71% of 42 pairs flipped
- DeepSeek V4 Flash: 68% of 50 pairs flipped
- Gemini 3.5 Flash: 64% of 47 pairs flipped
- Mistral Small: 62% of 42 pairs flipped
- Claude Haiku 4.5: 59% of 32 pairs flipped
- Grok 4.1 Fast: 58% of 50 pairs flipped
- GPT-5.4 mini: 58% of 38 pairs flipped
- Perplexity Sonar: 47% of 36 pairs flipped

## Category by category

| Category | Leader | Share, run one | Share, repeat | Move | Leader |
|---|---|---|---|---|---|
| Cap table management | Carta | 44% | 51% | 7 points | held |
| Sales tax automation | Avalara AvaTax | 40% | 34% | -6 points | held |
| Entity management | Athennian | 18% | 22% | 4 points | held |
| Business banking | Mercury | 20% | 17% | -3 points | changed: Rho |
| Board | OnBoard | 25% | 22% | -3 points | held |
| Accounts receivable auto | Zoho Books | 15% | 17% | 2 points | changed: Billtrust |
| Account reconciliation | FloQast | 33% | 35% | 2 points | held |
| SaaS metrics | ChartMogul | 45% | 46% | 1 point | held |
| Financial close manageme | FloQast | 60% | 60% | 0 points | held |
| Accounts payable automat | Stampli | 19% | 18% | 0 points | changed: Melio |

Share floor: 6 points (the 90th percentile); median move 3 points; largest 7 points. Pooled flip rate 68%.

Published under CC BY 4.0. The output is the models' output; nothing here is a recommendation by the index.