Overstock TechKno 2021 has ended
Welcome, TechKno 2021 Attendees!
  • If you didn’t get a chance to place your swag order the store is now OPEN! Please use the link here to get to the online swag store. Quantities are very limited so be sure to get your swag before it runs out!  

Back To Schedule
Thursday, September 23 • 11:00am - 11:50am
Statistical Testing for Experiments

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Departments across Overstock conduct experiments to test new product features and algorithm changes before they go into production. These are typically A/B tests performed on live traffic and rely on statistical analysis to determine whether the observed difference is real or merely reflect random fluctuations in the data. There are many practical challenges, such as measuring small effects, business needs to conclude experiments efficiently, high variability in the metrics of interest etc. This talk will address some of these challenges and highlight the importance of choosing the appropriate statistical method to measure effects reliably.


Thursday September 23, 2021 11:00am - 11:50am MDT