Eight of fourteen models named Ramp first on the direct prompt; one named Payhawk. Ramp was named by fourteen of the fourteen models and Payhawk by eleven and Ramp carries 66 labels and Payhawk 24, so the shares are not directly comparable.
Named in seventeen categories this edition.
Named in seven categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the spend management platforms page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Three of three in this category shown.
“Users frequently cite issues with receipt management, such as problems with voiding transactions and unusable CSV exports.” Mistral Small · negative prompt · hard negative
“Many modern platforms (like Ramp and Brex) are "free" because they require you to migrate your company credit cards to their proprietary cards.” Gemini 3.5 Flash · negative prompt · soft negative
“Ramp: Excellent for fast-growing mid-market companies. Strong automation, great ERP integrations, flat-rate cashback... Very popular for consolidated card, AP, and expense.” Gemini 3.5 Flash · scale prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Three of three in this category shown.
“Many (e.g., Navan, Payhawk) require demos for quotes; watch for per-user fees” Grok 4.1 Fast · negative prompt · soft negative
“Payhawk is the best overall starting point for a mid-sized B2B company that wants genuine all-in-one spend control” Perplexity Sonar · paraphrase prompt · first choice
“a unified spend platform (like Payhawk or Airbase-type solutions) typically fits best” DeepSeek V4 Flash · scale prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.