← All articles
cold emailLLMbenchmarksGemini

Flash or Pro LLM for cold email? We sent 100,000 emails to find out

Every AI vendor sells a cheap Flash tier and a pricier Pro tier. We wrote 100,000 cold emails with both and measured what each dollar bought. Flash wins the click. Pro wins the reply. Here is the data.

Flash or Pro LLM for cold email? We sent 100,000 emails to find out

The bet

Every AI vendor now sells the same model family in tiers. Flash, the cheapest. Pro, the middle. Frontier, the most expensive. Pro costs about 5x Flash per token, and everyone has a reflex about it: the pricier model must convert better, so the question is whether it converts enough better to pay for itself.

What the tiers cost per 10M output tokens (USD, list price) Flash $25 Pro $120 Gemini 3.5 Flash-Lite vs Gemini 3.1 Pro. Same gap at DeepSeek, Z.ai and Moonshot.

The test

We wrote 100,000 cold emails with both tiers, on real campaigns for real clients, and counted two things per dollar spent: how many people clicked the link, and how many wrote back with interest.

The twist

Both tiers won. Just not the same match.

Cost per website visit (USD, lower is better) Flash $3 Pro $18 Flash: 34,506 emails, 423 visits. Pro: 57,650 emails, 273 visits.
Cost per positive reply (USD, lower is better) Flash $1,369 Pro $168 Flash: 1 positive reply. Pro: 29 positive replies.

Flash buys the click 6x cheaper. Pro buys the reply 8x cheaper. The premium does not pay for itself. It pays for a different outcome.

The rule

YOU WANT Website visits Signup funnel, self-serve product, landing page, webinar. Use Flash. YOU WANT Positive replies A conversation, a demo, a booked sales meeting. Use Pro.

Why

A click is cheap to earn: a decent email with a link, and some people click. A reply is expensive to earn: someone has to read, believe and type. Across all 100,000 emails a positive reply was 22x rarer than a click. The stronger model earns its keep exactly where the bar is higher.

We have not tested the Frontier tier yet. At 5 to 10x the Pro price, the reply would have to get a lot cheaper still. We will publish that when we have it.

What it means if we run your campaigns

You never pick a model. Each campaign on distribute.you runs on the workflow with the best measured cost for what that campaign is buying, across every client, and the pick moves when the numbers move. You pay the budget the campaign spent, nothing else, and you watch the cost of each positive reply land on your dashboard.

Start with your website URL. The first 30 USD are on us.

Method

  • Scope: sales cold email outreach only. Journalist outreach, PR pitches and every other channel we run are excluded.
  • Window: April 14 to September 8, 2026, every client account. Production data from the distribute.you platform, read on September 8, 2026.
  • Volume: 95,661 emails to 33,243 people, $6,716 of platform spend, 698 website visits, 31 positive replies. 20 workflows (a workflow is one prompt and one model); workflows configured but never run are excluded.
  • Tiers: Flash, the cheapest model of a family (Gemini Flash, Claude Haiku, DeepSeek V4 Flash, GLM Flash, Kimi K2.6). Pro, the middle (Gemini Pro, Claude Opus, DeepSeek V4 Pro, GLM 5.3, Kimi K3). Frontier, the most expensive (Claude Fable, Astra), not yet run in production.
  • What ran: Flash tier, 4 workflows on Gemini 3.5 Flash-Lite and Gemini 3.5 to 3.8 Flash, 34,506 emails, $1,369. Pro tier, 12 workflows on Gemini 3.1 Pro, 57,650 emails, $4,869. DeepSeek V4 Pro and GLM 5.3 (Pro tier, 3,505 emails, $478) are too early to rank and are not in the charts.
  • Spend: everything the workflow cost before per-account discounts: lead sourcing, enrichment, sending and tokens. Not tokens alone.
  • Website visit: a recipient clicked the tracked link. Counted once per person.
  • Positive reply: a recipient wrote back with interest (a question, a request for details, a meeting). Classified automatically, reviewed by a person on the account. Negative replies, out-of-office and unsubscribes do not count.
  • Template check: the tiers did not run the same prompts evenly. On the prompt family that asks for a click only, Flash still bought the visit for less ($3 vs $8) and Pro still bought the reply for less ($256 vs $1,369).
  • Limits: not a randomised experiment. Our optimiser assigns workflows by measured cost, so Pro workflows ran more on reply-seeking campaigns. 31 positive replies is a small count. We report counts and no confidence intervals.
Per-workflow data and list prices

Spend in USD, rounded to the dollar. CPWV is cost per website visit, CPPR is cost per positive reply, left blank under two replies.

WorkflowTierModelEmailsSpendVisitsRepliesCPWVCPPR
LithiumProGemini 3.1 Pro25,3782,231781929117
RampartFlashGemini Flash-Lite19,39661822203
PelicanFlashGemini Flash9,45840810004
PermafrostProGemini 3.1 Pro9,0085978727299
LegatoProGemini 3.1 Pro8,2313909004
AzaleaProGemini 3.1 Pro5,49359344148148
OspreyFlashGemini Flash-Lite4,3022318613
BalladProGemini 3.1 Pro3,1633950499
CeruleanProDeepSeek V4 Pro1,86833601
TrailblazerProGemini 3.1 Pro1,3578400
DawnFlashGemini Flash-Lite1,3501131508
VectorProGemini 3.1 Pro1,24115614011
TangoProGemini 3.1 Pro8818500
MoraineProGemini 3.1 Pro8758400
ColchisProGemini 3.1 Pro8318500
HeliumProGemini 3.1 Pro6978500
RudderProDeepSeek V4 Pro5794700
AllegroProDeepSeek V4 Pro5314700
NobeliumProGLM-5.2 / 5.3527472024
WisteriaProGemini 3.1 Pro4958400

List prices per million tokens, USD, standard context, paid tier, read from each vendor's own page on the date shown.

ModelTierInputOutputSource, date read
Gemini 3.5 Flash-LiteFlash0.302.50ai.google.dev, 2026-09-08
Gemini 3.8 FlashFlash0.75 (1.50 from 2027-01-01)3.75 (7.50 from 2027-01-01)ai.google.dev, 2026-09-08
Gemini 3.1 Pro PreviewPro2.0012.00ai.google.dev, 2026-09-08
DeepSeek V4 FlashFlash0.22 off-peak, 0.44 peak0.66 off-peak, 1.32 peakapi-docs.deepseek.com, 2026-08-15
DeepSeek V4 ProPro0.66 off-peak, 1.32 peak1.98 off-peak, 3.96 peakapi-docs.deepseek.com, 2026-08-15
GLM-5.3-FlashFlash0.15 (0.075 promotional)0.50 (0.25 promotional)docs.z.ai, 2026-09-08
GLM-5.3Pro1.404.40docs.z.ai, 2026-09-08
Kimi K2.6Flash0.954.00platform.kimi.ai, 2026-08-16
Kimi K3Pro3.0015.00platform.kimi.ai, 2026-08-16
← All articlesUpdated September 8, 2026