Nine of fourteen models named ChartMogul first on the direct prompt; one named Amplitude. ChartMogul was named by fourteen of the fourteen models and Amplitude by thirteen and ChartMogul carries 65 labels and Amplitude 27, so the shares are not directly comparable.
Named in two categories this edition.
Named in one category this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the saas metrics and analytics page.
Across every category in the October 2026 Edition, ChartMogul and Amplitude were named in the same answer seventy-one times, of the 189 answers naming ChartMogul and the 81 naming Amplitude. In those answers Amplitude took the first choice three times and ChartMogul thirty-three.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Avoid Baremetrics, basic ChartMogul, basic ProfitWell, and Tableau” GLM 4.7 FlashX · negative prompt · hard negative
“criticize it for assuming simple sales processes, leading to poor fits for complex revenue recognition or cohorts” Grok 4.1 Fast · negative prompt · soft negative
“Metric discrepancies - Users frequently report that ChartMogul's numbers don't always match their billing system” Kimi K2 · negative prompt · soft negative
“I'd recommend either ChartMogul for focused revenue metrics or Mixpanel/HubSpot if you want to connect product behavior to ARR” Claude Haiku 4.5 · paraphrase prompt · first choice
“has been the gold standard for SaaS metrics since 2014 and is the most powerful option for companies with complex billing needs” Claude Haiku 4.5 · comparative prompt · first choice
“ChartMogul and Databox are the top recommendations due to their ease of use, strong feature sets, and affordability.” Mistral Small · direct prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Amplitude is terrible at calculating Net Revenue Retention (NRR), churn reasons, LTV:CAC ratios, or forecasting cash flow accurately” Llama 4 Maverick · negative prompt · hard negative
“it's not recommended for CFO-level financial reporting or accurate calculation of key SaaS metrics” Mistral Small · negative prompt · hard negative
“Avoid using these as your primary SaaS revenue metrics tool.” DeepSeek V4 Flash · negative prompt · hard negative
“Amplitude is best for mid-market to enterprise SaaS with dedicated data teams... very strong for B2B SaaS companies, and its cohort analysis is the best.” Claude Haiku 4.5 · direct prompt · first choice
“If you want to know what users do in the app: start with Amplitude or Mixpanel.” GPT-5.4 mini · comparative prompt · first choice
“Need deep product behavior insights with AI? → Amplitude” Kimi K2 · comparative prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.