[Seedcamp Firsts] How to A/B Test Product Changes and Set up Good Data Science Practices

This Much I Know - The Seedcamp Podcast

Content provided by The Seedcamp Podcast and Carlos Espinal. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by The Seedcamp Podcast and Carlos Espinal or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

1+ y ago 26:08

MP3•Episode home

Fetch error

Hmmm there seems to be a problem fetching this series right now. Last successful fetch was on April 15, 2025 10:11 (2M ago)

What now? This series will be checked again in the next day. If you believe it should be working, please verify the publisher's feed link below is valid and includes actual episode links. You can contact support to request the feed be immediately fetched.

In a follow-up to their Seedcamp Firsts conversation on data, our Venture Partner Devin Hunt and Candice Ren, Founder of analytics agency 173Tech and a member of the Seedcamp Expert Collective, dive deep into A/B testing and good data science practices. With new and exciting AI technology emerging around recommendation engines, how can product leads evaluate which solution is better and how to really measure a “better recommendation”? Focusing on a specific case study - a furniture marketplace, Candice, who worked on A/B testing and recommendation engines for Bumble, Plend Loans, MUBI, Treatwell and many others, shares her thoughts on: - the intricacies of setting up and analyzing an A/B test experiment focused on comparing two different recommendation algorithms - how you set your hypothesis - the best way to segment your user basis - how to select what you are controlling for (e.g. click-through rate) - how to interpret test results and consider broader business metrics impact. Candice and Devin also emphasize the importance of granular testing, proper test design, and documentation of test results for informed decision-making within a company's testing framework.

302 episodes

#Tech #Artificial Intelligence #Carlos Espinal #Tech Startups #Business #Entrepreneur #I Know