Support Article
Statistics Variance is large when Randomization is 50-50%
Summary
When Randomization is set at 50-50%, statistics displays a large variance. The user requires a variance that is <= 1% only within any given campaign run.
|
Randomization % |
||||||||
OC_CAMPAIGNTREATMENTNAME |
|
13-Aug |
14-Aug |
15-Aug |
16-Aug |
17-Aug |
18-Aug |
19-Aug |
20-Aug |
Day23_AutoPmt_Email |
|
50.86% |
51.48% |
51.18% |
51.10% |
50.47% |
50.88% |
50.54% |
51.00% |
Day9_AutoPmt_Email |
|
48.85% |
49.41% |
48.79% |
49.35% |
48.17% |
48.60% |
49.06% |
48.07% |
Day2_Final_Email |
|
50.79% |
50.84% |
50.96% |
51.01% |
50.22% |
51.07% |
51.19% |
50.57% |
Day14_Value_Email |
|
51.30% |
51.13% |
51.81% |
51.60% |
51.24% |
50.91% |
51.08% |
50.64% |
Day25_TextEnroll_Email |
|
49.09% |
48.94% |
48.84% |
49.12% |
49.09% |
49.03% |
48.72% |
48.89% |
Day21_LoyaltyVideo_Email |
|
48.82% |
48.98% |
49.10% |
49.07% |
49.12% |
48.57% |
49.42% |
49.22% |
Day9_AutoPmt_Push |
|
49.26% |
49.42% |
46.79% |
49.29% |
48.91% |
48.52% |
49.27% |
46.15% |
Day2_Final_Push |
|
52.06% |
50.93% |
51.89% |
50.47% |
50.62% |
50.82% |
51.73% |
50.90% |
Day21_LoyaltyVideo_Push |
|
51.23% |
50.81% |
50.68% |
50.85% |
51.30% |
51.59% |
51.40% |
51.19% |
Day14_Value_Push |
|
49.10% |
48.93% |
50.62% |
47.16% |
52.21% |
48.92% |
48.78% |
49.07% |
Day23_AutoPmt_Push |
|
50.89% |
50.46% |
51.07% |
51.33% |
50.78% |
51.02% |
51.09% |
50.85% |
Day90_Renew_CallIn |
|
49.03% |
49.26% |
49.36% |
49.12% |
49.56% |
49.18% |
48.46% |
49.37% |
Error Messages
Not Applicable
Steps to Reproduce
Run a Campaign with Randomization configured.
Root Cause
A defect in Pegasystems’ code or rules
The Champion Challenger rule does not provide truly random results. This is because the expression '=' is missing in the code.
Resolution
Perform the following local-change:
Use a Switch component with a Select based on Java.random.
In the earlier versions where direct use of Java is still possible, use the below condition:
""+@java("Math.random()<0.5")
In the newer versions, a built-in library version is present for the Switch condition:
@random()<0.5
The logic to implement the Switch component is to achieve random distribution when there are more than two offers to choose.
- Add a Set Property before the Switch.
- In the SetProperty, generate a Random number.
- In the Switch, consult the SetPropery value.
Published October 2, 2019 - Updated December 2, 2021
Have a question? Get answers now.
Visit the Collaboration Center to ask questions, engage in discussions, share ideas, and help others.