The Experimentation Gap
<p>Over the past two decades, online, controlled experiments have become an increasingly core part of the way that many of the most successful tech companies develop products. Companies like Airbnb, Booking.com, Microsoft, Google, Netflix, Doordash, and Stitch Fix run <a href="https://www.reforge.com/brief/airbnb-growth-principles-for-effective-experimentation#I5AU3sKz0emcsneiPu6EbQ" rel="noopener ugc nofollow" target="_blank">tens of thousands of experiments per year</a>, and as a result are able to rigorously quantify the impact of most of the ideas and features they launch. In many cases, the outcomes of even simple experiments can be profound — <a href="https://hbr.org/2017/09/the-surprising-power-of-online-experiments" rel="noopener ugc nofollow" target="_blank">Bing once improved its annual ad revenue by 12% due to an experiment an engineer ran that simply re-adjusted the ad header layout</a>. More broadly, even if the impact of each experiment is more marginal, the compounding effects of thousands of small, positive changes a year can end up resulting in a profoundly better product.</p>
<p><a href="https://towardsdatascience.com/the-experimentation-gap-3f5d374d354c"><strong>Read More</strong></a></p>