E296 | What Thousands Of A/B Tests Reveal About Websites That Convert And Retain With Casey Hill

Content provided by Andrew Michael. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Andrew Michael or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

CHURN FM »
E296 | What thousands of A/B tests reveal about websites that convert and retain with Casey Hill | DoWhatWorks

14d ago 45:08

MP3•Episode home

Today on the show we have Casey Hill, CMO of DoWhatWorks, a patented growth experiment tracking engine that reveals which website changes actually drive results. Casey brings experience from ActiveCampaign, his work as a Stanford instructor and advisor, and years of research into how leading companies like Slack, Shopify, and Asana run experiments.

In this episode, Casey breaks down why most A/B tests fail and how to focus on the few elements that truly move the needle. We explore why two CTAs often outperform one, why customer logo bars underdeliver, and why expectation-to-reality alignment is the hidden driver of both conversions and retention.

Casey also shares how DoWhatWorks blends large-scale data with human research to surface reliable best practices, why expansion revenue has become its biggest growth lever, and how enterprise clients are tackling churn by setting clear expectations from day one.

We also discuss how onboarding experiments reduce early churn, why traffic sources should shape your CTA strategy, and why simplicity always wins on pricing pages.

As usual, I'm excited to hear what you think of this episode, and if you have any feedback, I would love to hear from you. You can email me directly on [email protected]. Don't forget to follow us on X.

Churn FM is sponsored by Vitally, the all-in-one Customer Success Platform.

Chapters

1. E296 | What thousands of A/B tests reveal about websites that convert and retain with Casey Hill | DoWhatWorks (00:00:00)

2. Focusing CRO Efforts Where They Matter Most (00:02:38)

3. Inside DoWhatWorks: Detecting and Tracking A/B Tests (00:05:24)

4. Why Most A/B Tests Fail and the Role of BetScores (00:07:45)

5. Public Data Versus First-Party Insights (00:10:44)

6. Experiments That Boost Activation and Retention (00:13:37)

7. DoWhatWorks’ Approach to Churn and Retention (00:20:28)

8. How Marketing Powers Expansion Growth (00:25:48)

9. Casey’s Playbook for a High-Converting Homepage (00:30:29)

10. Lessons on Churn and Casey’s Costly Mistake (00:38:37)

297 episodes

#Business Trends #Tech #Andrew Michael #Business #Retention #Engage #Delinquent Churn #Subscription Economy #Marketing #Customer Success #Entrepreneur #CHURN #Activism #Price #Referrals #Productivity