Have you done any A/B experiments?
⠀
All Direct clients have the opportunity to compare a variety of campaign settings.
And in Metrica, there was a report that will help you understand which of the options was better.
Drawing conclusions is easy: the system will automatically check whether enough data has accumulated for analysis, and compare the indicators by which you want to evaluate the result.
⠀
The winning values of the indicators will be highlighted in green, and the less successful ones in red.
⠀
We tell you how to work with the report.
⠀
You have to wait until you have enough statistics (about two weeks), and if you don’t have enough data, you can’t be sure which one is better.
Select the desired experiment in the report and enable comparison mode
Select a control campaign, which is the one you want to compare the results of the other campaigns in the experiment with, and it’s usually a campaign where you didn’t change any settings.
⠀
If the data for comparison is sufficient, in comparison mode, the indicators will be highlighted by color:
green – the indicator in the experimental campaign was significantly better than in the control red – significantly worse
gray – there is enough data, but the indicators of the control campaign do not differ from the experimental ones.
If the indicator is not highlighted by color, then the data is too little for comparison – you need to wait for some more time or start a new experiment with other settings that allow you to collect more traffic.