AB Testing 101
<p>I started my career as a software engineer at Applied Predictive Technologies (APT), which sold multi-million dollar contracts for sophisticated AB testing software to Fortune 500 clients and was acquired by Mastercard in 2015 for $600 million. So I’ve been involved in AB testing since the beginning of my career.</p>
<p>A few years later I was VP of Engineering at Storyblocks where I helped build our online platform for running AB tests to scale our revenue from $10m to $30m+. Next at Foundry.ai as VP of Engineering I helped build a <a href="https://en.wikipedia.org/wiki/Multi-armed_bandit" rel="noopener ugc nofollow" target="_blank">multi-armed bandit</a> for media sites. Then a few years later I helped stand up AB testing as an architect at ID.me, a company valued at over $1.5B with $100m+ in ARR.</p>
<p>So I should have known a lot about AB testing, right? Wrong! I was surprised just how little I knew after I joined the AB testing platform company <a href="https://www.geteppo.com/" rel="noopener ugc nofollow" target="_blank">Eppo</a>. Below is a synthesis of what I wish I’d known about AB testing when I started my career.</p>
<h1>What is AB Testing?</h1>
<p>First things first, let’s define what AB testing is (also known as split testing). To quote Harvard Business Review, “A/B testing is a way to compare two versions of something to figure out which performs better.”</p>
<p><a href="https://medium.com/jonathans-musings/ab-testing-101-5576de6466b">Click Here</a></p>