Assess - General Introduction
Datama Assess allows you to quickly assess the statistical significance of a difference on any KPI between two points
Datama Assess allows you to quickly assess the statistical significance of a difference on any KPI between two points
The significance of the difference can be assessed between two variants of an AB test, two periods of time, or basically anything you would like to compare.
You can define which segment you want to compare in the Comparison pill and which KPI you are assessing in the Metric pill,
Statistical significance is assessed using Statistical tests, and you can play with those tests and significance levels using the settings
💡If you don’t know what is Statistical Significance, here is a quick example:
-
Imagine you want to know what is the average age of male vs. female in your city.
-
You go outside and ask 10 males and 10 females for their age. You get an average of 50 years for Males, and 40 years for females. The average difference of age between males and females would be 20%.
-
But you obviously understand that this average is not statistically significant and you would be more confident in this datapoint if you would have asked more people about their age.
-
Well, the question of when you can be confident that this result is close to the real number is exactly the question of statistical significance 🤓