Source: netflixtechblog.com
What is an A/B Test?Category: Data
Martin Tingley with Wenjing Zheng, Simon Ejdemyr, Stephanie Lane, and Colin McFarlandThis is the second post in a multi-part series on how Netflix uses A/B tests to inform decisions and continuously innovate on our products. Subsequent posts will go into more details on the statistics of A/B tests, experimentation across Netflix, how Netflix has invested in infrastructure to support and scale experimentation, and the importance of the culture of experimentation within Netflix.
we want to learn if a new product experience that flips all of the boxart upside down in the TV UI is good for our members.
Suppose we look at the click through rate, measuring the fraction of members in each experience that clicked on a title.
Our goal is to limit any downside consequences and to ensure that the new product experience does not have unintended impacts on the member experience.
we want to learn if a new product experience that flips all of the boxart upside down in the TV UI is good for our members.
Suppose we look at the click through rate, measuring the fraction of members in each experience that clicked on a title.
Our goal is to limit any downside consequences and to ensure that the new product experience does not have unintended impacts on the member experience.
Related Articles
Community Partners
DevOps Careers