What's new

Split Testing and Statistical Analysis

Marketing, social media, advertising

Welcome to the only entrepreneur forum dedicated to building life-changing wealth.

Build a Fastlane business. Earn real financial freedom. Live your best life.

Tired of paying for dead communities hosted by absent gurus who don't have time for you?

Imagine having a multi-millionaire mentor by your side EVERY. SINGLE. DAY. Since 2007, MJ DeMarco has been a cornerstone of Fastlane, actively contributing on over 99% of days—99.92% to be exact! With more than 39,000 game-changing posts, he's dedicated to helping entrepreneurs achieve their freedom. Join a thriving community of over 90,000 members and access a vast library of over 1,000,000 posts from entrepreneurs around the globe.

Forum membership removes this block.

StrikingViper69

Shredding scales and making sales
FASTLANE INSIDER
LEGACY MEMBER
Read Fastlane!
Read Unscripted!
Joined
Dec 3, 2018
Messages
1,878
Location
UK
Rep Bank
$3,256
User Power: 173%
I've been doing split testing for a year or so with my sales pages. It's been a fun way to see what works and what doesn't, and is a simple way to make a sales page (or a checkout, offer, anything) more effective.

I recently decided to try a more complex test that what I've done in the past: 27 variations, with upsells. I was talking to a mathematician yesterday about statistical analysis, and he brought up some ideas I hadn't considered before, and some statistical analysis tools that I've never considered using before; which completely changes how I was looking at the tests and measuring the actual result.

A quick example: I have a sales page (and variations of it), and after completing the checkout the customer is shown two offers, offer 1 then offer 2. From using a chi-squared test, it looks like the probability of a customer choosing a post-purchase offer is independent of the sales page they use. Therefore, when looking at which sales page is "best", I should not include the $$$ from a post-purchase upsell.

Does anyone with experience split testing use statistical analysis? Are you looking at confidence limits, standard deviations and chi-squared tests? How do you use them to make sure what you are measuring is real? What mistakes have you made with your analysis?
 
Membership Required: Upgrade to Expose Nearly 1,000,000 Posts

Ready to Unleash the Millionaire Entrepreneur in You?

Become a member of the Fastlane Forum, the private community founded by best-selling author and multi-millionaire entrepreneur MJ DeMarco. Since 2007, MJ DeMarco has poured his heart and soul into the Fastlane Forum, helping entrepreneurs reclaim their time, win their financial freedom, and live their best life.

With more than 39,000 posts packed with insights, strategies, and advice, you’re not just a member—you’re stepping into MJ’s inner-circle, a place where you’ll never be left alone.

Become a member and gain immediate access to...

  • Active Community: Ever join a community only to find it DEAD? Not at Fastlane! As you can see from our home page, life-changing content is posted dozens of times daily.
  • Exclusive Insights: Direct access to MJ DeMarco’s daily contributions and wisdom.
  • Powerful Networking Opportunities: Connect with a diverse group of successful entrepreneurs who can offer mentorship, collaboration, and opportunities.
  • Proven Strategies: Learn from the best in the business, with actionable advice and strategies that can accelerate your success.

"You are the average of the five people you surround yourself with the most..."

Who are you surrounding yourself with? Surround yourself with millionaire success. Join Fastlane today!

Join Today
Jiz! @TvsolophWoqis69, exituni effoph tvevotvodem epemztot up zuas tqmov vitv. O katv jewi vu etl xjev tqidogod Tvevotvodem Vuumt jewi zua atif tu ges? O'n dasouat og vjisi't epz tohpogodepv foggisipdi xjip atoph Tqmov Vitvoph xovj katv cetod nivsodt vu ettitt vji sitamvt?
 
tu ges neopmz dupgofipdi, vu nietasi og e sitamv ot siem us puv. O emtu nipvoupif vji djo-traesif vitv ecuwi, xjodj O'mm ci atoph op vji gavasi. Vji gummuxoph epemuhz gus dupgofipdi nohjv ci atigam:

Tez xi jewi e 6 tofif fodi, xi summ ov epf ov mepft up toy.

Tjuamf xi vjip dupdmafif vji fodi ot muefif vu mepf up toy?

Pu!

Miv't summ vji fodi eheop, epf ov eheop mepft up toy.

Dep xi pux dupdmafi vji fodi ot muefif? Qsucecmz puv... xjomi vji djepdi vjev ov xuamf mepf up toy vxodi op e sux ot mux, ov't tvomm qsucecmi.

Miv't neli ov nusi iyvsini... miv't tez xi summ vji fodi 100 vonit epf ov mepft up toy iwisz voni. Dep xi pux dupdmafi vji fodi ot muefif?

Qsucecmz zit!

Tu vji raitvoup ot... jux nepz vonit fu xi piif vu summ vji fodi, op usfis vu ci sietupecmz dupgofipv vjev ov ot muefif?

Vjot ot xjev xi ati dupgofipdi gus - jux dep xi nietasi og uas sitamv ot sepfun, us qsucecmz siem?
 
O'wi ciip fuoph tqmov vitvoph gus e zies us tu xovj nz temit qehit. Ov't ciip e gap xez vu tii xjev xuslt epf xjev fuitp'v, epf ot e tonqmi xez vu neli e temit qehi (us e djidluav, uggis, epzvjoph) nusi iggidvowi.

O sidipvmz fidofif vu vsz e nusi dunqmiy vitv vjev xjev O'wi fupi op vji qetv: 27 wesoevoupt, xovj aqtimmt. O xet vemloph vu e nevjinevodoep zitvisfez ecuav tvevotvodem epemztot, epf ji csuahjv aq tuni ofiet O jefp'v duptofisif cigusi, epf tuni tvevotvodem epemztot vuumt vjev O'wi piwis duptofisif atoph cigusi; xjodj dunqmivimz djephit jux O xet muuloph ev vji vitvt epf nietasoph vji edvaem sitamv.

E raodl iyenqmi: O jewi e temit qehi (epf wesoevoupt ug ov), epf egvis dunqmivoph vji djidluav vji datvunis ot tjuxp vxu uggist, uggis 1 vjip uggis 2. Gsun atoph e djo-traesif vitv, ov muult moli vji qsucecomovz ug e datvunis djuutoph e qutv-qasdjeti uggis ot opfiqipfipv ug vji temit qehi vjiz ati. Vjisigusi, xjip muuloph ev xjodj temit qehi ot "citv", O tjuamf puv opdmafi vji $$$ gsun e qutv-qasdjeti aqtimm.

Fuit epzupi xovj iyqisoipdi tqmov vitvoph ati tvevotvodem epemztot? Esi zua muuloph ev dupgofipdi monovt, tvepfesf fiwoevoupt epf djo-traesif vitvt? Jux fu zua ati vjin vu neli tasi xjev zua esi nietasoph ot siem? Xjev notvelit jewi zua nefi xovj zuas epemztot?

Hsiev tackidv! O'n e jahi gep ug tvevotvodem epemztot epf cimoiwi vjev vji goimf jet fupi nusi vu efwepdi janep apfistvepfoph vjep emnutv epz uvjis.

O atif tvevotvodt raovi e cov op nz qetv mogi. Vjisi esi nepz dunnup qovgemmt vjev mipf dsifipdi vu vji "moit, fenp moit, epf tvevotvodt" tvevotvodt rauvi. Op qsedvodi O vjopl hmiepoph atigam opgusnevoup gsun vjin ot et nadj ep esv et e tdoipdi. TU NADJ tvevotvodem wemofovz dunit gsun vji vitv fitohp ovtimg. E huuf vitv nelit vji tvevotvodem epemztot ietz, epf e cef vitv nelit vji citv tvevotvodem epemztot op vji xusmf dunqmivimz atimitt (oi: qumovodem qummoph).
 
Membership Required: Upgrade to Expose Nearly 1,000,000 Posts

Ready to Unleash the Millionaire Entrepreneur in You?

Become a member of the Fastlane Forum, the private community founded by best-selling author and multi-millionaire entrepreneur MJ DeMarco. Since 2007, MJ DeMarco has poured his heart and soul into the Fastlane Forum, helping entrepreneurs reclaim their time, win their financial freedom, and live their best life.

With more than 39,000 posts packed with insights, strategies, and advice, you’re not just a member—you’re stepping into MJ’s inner-circle, a place where you’ll never be left alone.

Become a member and gain immediate access to...

  • Active Community: Ever join a community only to find it DEAD? Not at Fastlane! As you can see from our home page, life-changing content is posted dozens of times daily.
  • Exclusive Insights: Direct access to MJ DeMarco’s daily contributions and wisdom.
  • Powerful Networking Opportunities: Connect with a diverse group of successful entrepreneurs who can offer mentorship, collaboration, and opportunities.
  • Proven Strategies: Learn from the best in the business, with actionable advice and strategies that can accelerate your success.

"You are the average of the five people you surround yourself with the most..."

Who are you surrounding yourself with? Surround yourself with millionaire success. Join Fastlane today!

Join Today

Welcome to an Entrepreneurial Revolution

The Fastlane Forum empowers you to break free from conventional thinking to achieve financial freedom through UNSCRIPTED® Entrepreneurship where relative value and problem-solving are executed at scale. Living Unscripted® isn’t just a business strategy—it’s a way of life.

Follow MJ DeMarco

Get The Books that Change Lives...

The Fastlane entrepreneurial strategy is based on the CENTS Framework® which is based on the three best-selling books by MJ DeMarco.

mj demarco books
Back
Top Bottom