Settings of Datama Assess


Discover all settings exposed by Datama Assess extension to improve your analysis



Find below how you can customize Datama Assess using the General settings


1. General Settings

1.1. Comparison

This part allow to choose what you want to compare, you can also add others comparison to go deeper

Defining what you want to compare is the very first step of your analysis in Datama Compare as in Datama Assess In the waterfall you can either compare dates (start period vs end period) or segments of other dimensions

  1. First you need to select the dimension you want to choose for comparison, and the 2nd step is to select 2 segment within the dimension. For exemple (select Test Variant as a Dimension and Variation A and Variation B as the 2 segments)
  2. You can refine the selection with Advanced settings by filtering your selection


1.2. Modeling

Test to do:

For now Datama allows only Frequentist t test approach - see concept to learn more.

Since this assumes that observed variable are Bernoulli variables, this means that observed average ratios should always be between 0 and 1.

Level of confidence

Confidence interval is set in % to decide the level of confidence, or statistical power of your assessment. It ranges from 50% to 99%.

Depending on the test you are performing, this input can be used in different ways. Please refer to the concept section for more details

Test Side:

Long story short, for a typical AB test, 1-sided test readouts allows you to be confident that B is higher than A, and not that B is lower than A

Learn More here:

In Statistics hypothesis testing, we need to judge whether it is a one-tailed or a two-tailed test so that we can find the critical values in tables such as Standard Normal z Distribution Table and t Distribution Table. And then, by comparing test statistic value with the critical value or whether the statistical value falls in the critical region, we make a conclusion either to reject the null hypothesis or to fail to reject the null hypothesis.

How can we tell whether it is a one-tailed or a two-tailed test? It depends on the original claim in the question. A one-tailed test looks for an “increase” or “decrease” in the parameter whereas a two-tailed test looks for a “change” (could be increase or decrease) in the parameter. Therefore, if we see words such as “increased, greater, larger, improved and so on”, or “decreased, less, smaller and so on” in the original claim of a question (>,’<’are used in H1), a one-tail test is applied. If words such as “change, the same, different/difference and so on” are used in the claim of the question (≠is used in H1), a two-tailed test is applied.


2. Metrics Relation

This part allow you to edit your KPIs and market equation, when you want to fit your analysis with your business.

Using metrics relation allows you to change your market equation, add a unit, rename your step or even indicate a threshold, exclude or focus on a dimension. Metric relation describes the equation between metrics of your source, in order to compute the KPI you want to explain.


3. Preferences

These settings allow you to customize the application to fit with your company, you can also change the analysis language !

Language

For now only French and English are available, let’s us now if you want a new language to be added.


Fonts & Size



Get more information about extension interface or therotical concept of Datama.