Reddit Max or standard campaigns? What a 65% confidence winner is worth
Reddit Max is open to all advertisers and Reddit's split test calls winners at 65% confidence. How many conversions per arm you need before believing one.
- Reddit's 17% lower CPA claim is an average of 17 tests from summer 2025 with no published spread.
- A 65% winner bar is below the 70% that Google labels directional.
- Conversions per arm = (daily test spend / 2) x days / CPA. Under about 200, treat any winner as a lean.
- Pixel, conversion goal and optimisation window lock when a Max campaign is created. Decide them first.
Reddit announced on 3 September 2026 that Max campaigns are available to all advertisers. The headline claim is 17% lower cost per acquisition and 27% more conversions. Most coverage ends with the same advice: test Max against your current setup. Reddit sells a tool for that test. It is reported to call a winner at 65% confidence. This article works out what that result can and cannot prove, and what to do when your account is too small for it.
What changed on 3 September?
Max first reached selected advertisers in January 2026. Trade press reports three additions with the September release: support in the Advertising API, Smartly as the first third-party partner, and asset groups. Each asset group carries its own headlines, media and destination URL and can be reported separately.
Reddit's help centre page was still titled "Max Campaigns (Beta)" when we read it on 10 October 2026, and it does not yet mention asset groups. Several current guides have the opposite problem. They repeat January limits, such as traffic and conversions only, that the help page no longer shows.
What does Max take over, and what stays fixed?
The help page says there is no need to set up ad groups. You provide at least three headlines, at least one image or video and at least one audience hint. Objectives are traffic, app promotion, sales and leads. Ads can appear in any placement type.
Three details shape the decision.
- Hints are not limits. Communities, keywords and interests are suggestions the system can go beyond, according to trade coverage of the launch. Locations, custom audience exclusions and brand safety settings are reported as hard limits.
- Some fields lock. For sales and leads you choose the Reddit Pixel, the conversion goal and the optimisation window, and the help page says these cannot be changed later. Without a pixel or the Conversions API, only clicks are available as a goal.
- Edits restart learning. The help page says a campaign enters a calibration period after it is created or edited. It gives no length.
A standard campaign is not fully manual either. Reddit's targeting documentation strongly recommends automated targeting, which changes how your chosen audiences combine when it is switched on. "Standard" in any comparison needs that setting written down.
Where does the 17% figure come from?
From Reddit's alpha. Search Engine Journal reported it in January 2026: across 17 split tests run between June and August 2025, Max averaged 17% lower cost per acquisition and 27% more conversions than business-as-usual campaigns. Smartly adds that each test ran 21 days.
That is all that has been published. There is no spend per test, no conversion count, no spread, and no count of how many of the 17 favoured Max. An average of 17% can contain tests that lost. The September 2026 coverage reuses the same 2025 figure. We found no independent Max-against-standard result with volumes.
What does Reddit's own test cost?
Reddit's Split Testing tool went to all advertisers at the start of July 2026. It includes a "Reddit Max vs. Standard" template. As Social Media Today quotes Reddit, the audience is split at the user level, two flights run with one variable changed, and a winner is declared at 65% confidence.
Several outlets, including MediaPost, EMARKETER and The Keyword, report a minimum spend of $1,000 a day. Tests run two to six weeks. That is $14,000 to $42,000. At the 21 days Reddit used in its own tests, it is $21,000. January coverage of the Max beta reported a Max minimum of $20 a day, a figure we could not confirm on a Reddit page. If it holds, the official proof costs far more than the thing being proved.
We could not open Reddit's own announcement posts in this research. The 65%, the $1,000 floor and the test length come from outlets that agree with each other.
Is 65% confidence a high bar?
No. The comparison with Google shows why.
| Platform setting | Confidence | Platform's own label |
|---|---|---|
| Reddit Split Testing winner | 65% | Winner |
| Google Demand Gen experiments, default | 70% | Directional |
| Google Demand Gen experiments | 80% | Directional |
| Google Demand Gen experiments | 95% | Conclusive |
Google's help page also asks for at least 50 conversions per arm before it shows results. Reddit's bar sits below the lowest level Google offers.
Reddit has not said what its 65% means statistically. So the following is our reasoning under a stated assumption. If the tool crowns the treatment whenever it looks 65% likely to be better, then about 35 in 100 tests of two equal setups would still crown it. If either arm can win, about 70 in 100 tests of equal setups would produce a winner.
That reframes one of Reddit's launch statistics. In beta, 4 of 5 split tests identified a winning variant on return on ad spend, according to MediaPost and EMARKETER. A 65% bar would produce winners at something like that rate even when little differs.
Randomness on this scale is not hypothetical. Jon Loomer ran three identical Meta ad sets against each other. One finished with 100 conversions and another with 80, and Meta's tool gave the leader a 59% chance of winning. His conclusion: "Do not underestimate the contribution of randomness to your results." That was Meta and a single test. The arithmetic is the same on any platform.
How many conversions make a result believable?
Count conversions per arm before building anything.
Conversions per arm = (daily test spend / 2) x days / CPA
For two arms with equal spend, the gap in conversions needed to clear a confidence bar is roughly z x the square root of (2 / conversions per arm). This is a normal approximation with a single read at the end. It is a planning yardstick.
| Conversions per arm | Gap needed at 65% | At 90% | At 95% |
|---|---|---|---|
| 50 | 7.7% | 25.6% | 32.9% |
| 100 | 5.4% | 18.1% | 23.3% |
| 200 | 3.9% | 12.8% | 16.4% |
| 400 | 2.7% | 9.1% | 11.6% |
A hypothetical example. A brand runs the template at $1,000 a day for 21 days and the split is even, so each arm spends $10,500. The standard arm records 105 conversions at $100. The Max arm records 118 at $88.98. Max shows 12.4% more conversions and an 11% lower CPA.
That clears a 65% bar with room to spare. On our approximation it sits near 81%. A gap that size or larger would appear about one time in five if the two setups were equal. The dashboard says winner. The fair reading is leaning Max, not proven.
Now test Reddit's own claim. A 17% lower CPA is the same as 20.5% more conversions for the same spend. At 105 per arm, the 95% bar is about 23%, so a true effect of that size would usually fail to clear it. At about 200 per arm the bar falls to about 16%, and a true 17% CPA cut would clear it roughly six times in ten. That is why 200 per arm is the floor, not the target. Our note on how many ad concepts a budget can test covers the general false-winner sum.
Should you switch, test or wait?
| Your situation | Decision | What to check |
|---|---|---|
| No pixel or Conversions API events yet | Wait. Run a standard campaign first | Events firing and matched in Events Manager |
| Under $1,000 a day, fewer than about 100 Reddit conversions a month | Skip the short split. Decide on structure and judge over six to eight weeks before and after | Same attribution setting in both periods. Orders or CRM matched |
| $1,000 a day or more, 200 conversions per arm reachable in three to six weeks | Run the Reddit Max vs. Standard template and apply your own bar | Conversions per arm, not the badge |
| Lead generation judged on qualified leads | Keep standard as primary. Cap Max as a test | Qualified rate by arm. Exclusions set as hard limits |
| Several product lines with enough purchases | Test Max with one asset group per line | Per-group results are leads to investigate, not proof |
| Must appear only in named communities | Stay on standard with automated targeting off | Brand safety exclusions at account level |
The fourth row rests on a practitioner complaint. A Search Engine Land review of the platform in August 2026 asked Reddit for native CRM imports and self-serve incrementality tests, and described Reddit as generally considered a test channel.
On asset groups, separate reporting is not a controlled comparison. Products, offers and landing pages can all differ between groups, and delivery need not be even.
A seven-step method
- Count first. Work out conversions per arm from the formula. Under about 200, plan a longer run or skip the split.
- Fix what cannot be edited. Choose the pixel, conversion goal and optimisation window to match the standard campaign.
- Set one attribution rule. Reddit's default click window is 28 days, and its recommended type adds a 1-day view. Report both arms on the same setting and read click-through conversions separately.
- Set the hard limits. Locations, customer and lead exclusions, brand safety.
- Build a fair control. Same assets, same landing pages. Record whether automated targeting is on in the standard arm.
- Leave it alone. Edits send a Max campaign back into calibration. Run the planned length.
- Read it against your own bar. Compare conversions per arm with the table, then match a sample to orders or CRM records before moving budget.
Under $1,000 a day, the only route is a side-by-side or before-and-after comparison. It loses the user-level split. Reddit's help page says Max campaigns do not bid against your other campaigns but may still compete for impressions, so the two arms can reach the same people.
Where this stops
A split test shows which of two Reddit setups did better. It does not show whether the Reddit spend caused sales that would not have happened anyway. That is a separate question, and the one we worked through for Meta in incremental attribution or 7-day click.
Three unknowns remain. Reddit has not documented how its 65% is calculated, which metric decides the winner outside return on ad spend, or whether the $1,000 minimum is per test or per arm. Our example assumes per test and an even split.
If you want paid results judged against what your own records show, the waitlist is open.
Questions
What are Reddit Max campaigns?
An automated campaign type in Reddit Ads. Reddit's help centre says there is no need to set up ad groups. You supply at least three headlines, at least one image or video, at least one audience hint, a budget and a goal. The system chooses audiences, placements and creative combinations. Objectives listed are traffic, app promotion, sales and leads.
Where does the 17% lower CPA figure for Reddit Max come from?
From Reddit. It is the average of 17 split tests run with alpha advertisers between June and August 2025, each lasting 21 days, comparing Max with the advertisers' existing campaigns. Reddit has not published the spend, conversion counts or spread of results behind the average.
How much does Reddit's Split Testing tool cost to use?
Trade press reports a minimum spend of 1,000 dollars a day and a run of two to six weeks. That is 14,000 to 42,000 dollars. The tool has a Reddit Max vs. Standard template and splits the audience at the user level.
Is a 65% confidence winner reliable?
Not by itself. Reddit has not published how the figure is calculated. Google's Demand Gen experiments label 70% and 80% confidence as directional and 95% as conclusive, so 65% sits below the lowest setting Google offers. Treat the badge as a lean and check conversions per arm before moving budget.
Sources
- Reddit Ads Help Center, Max Campaigns (Beta) business.reddithelp.com
- Reddit Ads Help Center, Web Attribution business.reddithelp.com
- Reddit Ads Help Center, About Audience Targeting business.reddithelp.com
- Google Ads Help, Create A/B experiments for Demand Gen campaigns support.google.com
- Google Ads Help, Monitor your experiments support.google.com
- Smartly, Smartly and Reddit's Max campaigns smartly.io
- Jon Loomer Digital, Results, Identical Ad Sets, a Split Test, and Chaos jonloomer.com
- Social Media Today, Reddit expands AI-powered Max campaigns socialmediatoday.com
- Social Media Today, Reddit rolls out split testing to all advertisers socialmediatoday.com
- MediaPost, Reddit Releases 'Max' Campaigns To All Advertisers mediapost.com
- MediaPost, Reddit Unveils Ad Variant Testing Tool mediapost.com
- Search Engine Journal, Reddit Introduces Max Campaigns, Its New Automated Campaign Type searchenginejournal.com
- Search Engine Land, 12 things Reddit needs to make its ad platform more competitive searchengineland.com
- EMARKETER, Reddit adds A/B testing to attract performance marketers emarketer.com
- The Keyword, Reddit split testing thekeyword.co
- PPC Land, Reddit's Max campaigns cut costs by 17% through AI optimization ppc.land
- Wersm, Reddit Opens Its AI-Powered Max Campaigns To Every Advertiser wersm.com
- Paid Media Collective, Reddit introduces asset groups within Max campaigns paidmediacollective.com
- Social Samosa, Reddit expands Split Testing to all advertisers to compare campaigns socialsamosa.com
See where your brand stands.
Your Digital Authority Score, who AI recommends for your target questions, and the placements that close each gap. Your first report is free.
Get your free report →Most webinar no-shows say they will watch the replay. How many do, and what is a replay viewer worth?
84% of webinar no-shows say they will watch the replay. Platform data puts replay-only viewing at 2 to 20 per 100 registrants. How to count and value them.
→2026.10.10 · 8 MINSearch Console now counts your AI impressions but not the clicks. What is an AI impression worth?
Google's generative AI report shows impressions and nothing else. How to join it to the Performance report and estimate the click rate it leaves out.
→2026.10.09 · 8 MINTikTok Ad Network is now in US campaigns. Decide the placement before you build
TikTok's off-platform network reached US campaigns on October 5. Placement locks at creation. A decision table, a break-even sum and a seven-step method.
→