Tag: Statistical

How to Select the Right Statistical Tests for Different A/B Metrics

While the t-tests are powerful, they are not universally applicable in the data world that is populated by business metrics with various distributions significantly different from the nice uni-modal normal distribution. For instance, the number of gifts sent and share actions per user is usually hig...

Practitioner???s Guide to Statistical Tests

Hi, we are Nikita and Daniel from the CoreML team at VK. It’s our job to design and improve recommender systems for friends, music, videos and the news feed. This involves tons of A/B tests, and our progress at the end of the day relies heavily on how accurate and efficient...

Fooled by statistical significance

Statistical insignificance Contrary to popular belief, the term “statistically significant” does not mean that something important, momentous, or convincing took place. If you think that we’re using the word significant here in a way that would make...

Populations vs Sample, the statistical insights explained simply

Statistics begins by recognizing populations versus samples. Understanding this distinction is fundamental for effective statistical analysis and decision-making The first thing you do in statistics tofigure out if you’re dealing with all the data (population) or just some of it (sample...

Charting the Non-Parametric Odyssey: Statistical Frameworks for Distribution-Free Hypothesis Testing

Statistics is the corpus of instruments of knowledge that allow us to infer from data through tools including, but not limited to, estimation of parameters, construction of confidence intervals, and hypothesis testing to validate our assumptions. In this article, we will learn about frameworks that ...

A Deep Dive into the Science of Statistical Expectation

It was the summer of 1988 when I stepped onto a boat for the first time in my life. It was a passenger ferry from Dover, England to Calais, France. I didn’t know it then, but I was catching the tail end of the golden era of Channel crossings by ferry. This was right before budget airlines and ...

Statistical Experiments With Resampling

Most people working with data make observations and then wonder whether these observations are statistically significant. And unless one has some formal training on statistical inference and past experience in running significance tests, the first thought that comes to mind is to find a statistician...

Decoding Statistical Significance: A Marketer???s Guide

Google Trends reveals a significant surge in interest surrounding “Marketing Impact” (appendix 1.1). The term resonates in boardrooms, representing the pursuit of proving marketing’s value by measuring marketing’s effectiveness and achieving a return on investment. Th...