Frequentist (other)

In the frequentist approach, the outcome can be any variable. However, the data should be either unaggregated, or aggregated in comparable groups.

If the outcome variable is binary and data is aggregated, the Frequentist (Bernoulli) test should be used instead (for a precious gain of statistical power).

Behind the scenes: A frequentist Welch t-test is computed to test whether the mean outcome is significantly different between the Start period and the End period. The standard deviation used in the test is derived from the properties of the sample (from the sample variance).

See also: wikipedia

Test data: Gsheet

Negative variance warning This warning can be displayed when the data you are analyzing has a variance that is negative, which makes the overall T-test impossible to perform. You might want to think twice about which test you’re willing to compute and why.