Experimentation

Design A/B tests, read their results honestly and decide what to ship.

  1. 01

    Explain an A/B Test

    • easy
  2. 02

    Write a Test Hypothesis

    • easy
  3. 03

    Choose the Test Metrics

    • easy
  4. 04

    When Not to A/B Test

    • easy
  5. 05

    Explain Statistical Significance

    • easy
  6. 06

    How Long to Run a Test

    • medium
    • Pro
  7. 07

    Stop the Test Early?

    • medium
    • Pro
  8. 08

    The Test Came Back Flat

    • medium
    • Pro
  9. 09

    A Win That Faded

    • medium
    • Pro
  10. 10

    Winner Overall, Loser in One Country

    • medium
    • Pro
  11. 11

    Testing in a Marketplace

    • hard
    • Pro
  12. 12

    Ship It or Not?

    • hard
    • Pro