Getting started
Before using the Geo Tests module:- Set up event tracking.
- Connect at least one data source.
- Define at least one conversion.
- Ensure you have at least two months of conversion data.
Navigation
You can find the Geo Tests module in the left menu.Setting up an experiment
Create the experiment
Name the experiment, select the conversion and campaigns that will be used to measure incrementality, and choose an estimated experiment start date. All settings except for the conversion can be changed later.
Configure market selection
SegmentStream automatically selects the test and control markets, but you can adjust them if necessary.
Pause campaigns in test regions
Pause the targeted marketing efforts within the designated test regions.
Market selection
Market split
Select the geographic level at which the test and control markets will be chosen. Default options include city, country, and region.Default options rely on IP geolocation, which provides only approximate user locations. Using fine-grained geo splits such as “city” may significantly impact experiment results due to approximation inaccuracies.
Granularity
If there are not enough daily conversions to measure incrementality, select the Weekly granularity option. This affects both the sales cycle setting and how data is visualized in the conversion and cost charts.Sales cycle
Enter the typical duration for a user to achieve the set goal from their initial interaction with your brand. Understanding the sales cycle is essential as it determines the period over which the impact of a campaign should be evaluated.Test and control markets
The system analyzes trends, seasonality, and volume across various regions, choosing those with the highest correlation. A synthetic control approach is used to scale data from control regions to more closely align with the test regions’ data.Exclude markets
You can exclude any markets that should not be included in the experiment. After selecting the excluded markets, the test and control markets are recalculated.Minimum detectable effect
The minimum detectable effect (MDE) is detected once the test and control markets are selected. MDE is the smallest change in results that an experiment can reliably detect. If the incrementality is lower than this number, it cannot confidently be attributed to the campaigns within the experiment.Results
Once your experiment is launched, the metrics reflecting its progress are displayed.Incrementality
This metric presents the calculated incrementality of the campaigns involved in the experiment, as well as the total conversion difference between the test and control markets.Experiment evaluation
Once the experiment is done, a banner informs you if the results are strong enough to make clear conclusions and whether it is suggested to run the experiment again.
Charts
Conversion chart
The conversion chart displays two lines representing conversion trends over time for both test and control markets, including the experiment’s start and end dates. Before the experiment starts, the algorithm selects test and control markets so that their lines closely align. Once the experiment begins, the blue line (test markets) is expected to drop below the red line (control markets), indicating the effectiveness of the campaigns included in the experiment.
Cost chart
The cost chart shows the trend in advertising expenditure over time for the chosen test markets. It enables you to verify that the treatment is applied correctly throughout the experiment — indicated by the line remaining close to zero.