Assess - Significance methods


Significance calculation can be based on different methods available on the shelves in Datama Assess


Datama Assess is based on a method to compute significance anomalies called Frequentist Bernouilli Welch’s T test.



Frequentist Bernoulli

In the Bernoulli frequentist approach, the outcome has to be binary (1 or 0, e.g. Transactions). As long as this is true, any aggregation of the data can be used. The resulting chart shows the probability of distribution of the average value of the considered KPI.

assess - Frequentist model

Behind the scenes: A frequentist Welch t-test is computed to test whether the mean outcome is significantly different between the Start and the End values of your comparison. The standard deviation used in the test is derived from the properties of the Bernoulli distribution. See also: wikipedia Test data: Gsheet