Tag: Tests

How to Create Valuable Data Tests

Data quality has been widely discussed over the past year. The increasing adoption of data contracts, data products, and data observability tools certainly shows data practitioners’ commitment to providing high-quality data to their consumers. We all love to see this! One essential building...

One report for all test cases: Easily merging multiple tests reports

It's can be easily the case that you use different test runners for different kinds of your tests. You can choose to run the unit, interaction, and integration tests separately. You may have some smoke tests as well which run separately from exhaustive tests. In such a case, you will get diff...

Switchback Tests and Randomized Experimentation Under Network Effects at DoorDash

On the Dispatch team at DoorDash, we use simulation, empirical observation, and experimentation to make progress towards our goals; however, given the systemic nature of many of our products, simple A/B tests are often ineffective due to network effects. To be able to experiment in the face of netwo...

Practitioner’s Guide to Statistical Tests

Hi, we are Nikita and Daniel from the CoreML team at VK. It’s our job to design and improve recommender systems for friends, music, videos and the news feed. This involves tons of A/B tests, and our progress at the end of the day relies heavily on how accurate and efficient...

How to Select the Right Statistical Tests for Different A/B Metrics

While the t-tests are powerful, they are not universally applicable in the data world that is populated by business metrics with various distributions significantly different from the nice uni-modal normal distribution. For instance, the number of gifts sent and share actions per user is usually hig...