Let 's take up a use-case where we have an A/B activity such that 80% of traffic is assigned to (Control A) & 20% (Treatment B) and the we move to 50% (Control A) / 50% (Treatment B), then eventually  0% (Control A) / 100% (Treatment B).Hence After we went to 100% (Treatment B), How does  users get assigned to experiences ?

If you manually change the % split to 100% for Experience B,  Visitors who had previously been allocated to A (Control)  will stay in their initially-assigned experiences.  The traffic change will impact new entrants only.

It is recommended that, if you want to change percentages or greatly affect the flow of people into each experience, you should create or copy a new activity. Otherwise, if you change the percentages on different experiences, it will take a few days for the data to normalize again if many purchasers are return visitors. For example, if your A/B test is split 50/50, and then you change the split to 80/20, for the first few days after that change, the results might look skewed. If the average time to conversion is high, meaning it takes someone several hours or even days to make a purchase, these delayed conversions can affect the reports. So, in that first experience where the number went from 50 to 80, and the average time to conversion is two days, only people from the 50% of the population are converting on the first day of the test, although today 80% of the population is entering the experience. This makes it look like the conversion rate plummeted, but it will normalize again after these 80% of people have the two days to convert

Ta zawartość jest licencjonowana na warunkach licencji Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License  Posty z serwisów Twitter™ i Facebook nie są objęte licencją Creative Commons.

Informacje prawne   |   Zasady prywatności online