![creator](data:image/svg+xml,<svg xmlns="http://www.w3.org/2000/svg" width="200" height="200"><rect fill-opacity="0"/></svg>){kind=small}
Acquisition Analysis
Analysis that helps us identify and understand the sources and channels that attract new users, enabling us to optimize our marketing and user acquisition strategies for maximum impact.
Activation & Engagement Analysis
Analysis that helps us identify and address the factors that influence user adoption, retention, and ongoing interaction with the product, leading to improved user experience and increased product value.
| Metric | Control | Variant A | Variant B |
|---|---|---|---|
Measure Total Streams Completed | General Sample Size:298 Mean:7.6409 | Premium Lift:-8.39% Lift Confidence Interval:(-43.06%, 26.28%) Stat Sig:False (P-Value = 0.6339641) Sample Size:89 Mean:7 | Premium Plus Lift:-3.36% Lift Confidence Interval:(-36.47%, 29.74%) Stat Sig:False (P-Value = 0.8416486) Sample Size:112 Mean:7.3839 |
Funnel Analysis
Analysis that helps us identify and address bottlenecks or drop-offs in the user journey, improve product usability, and optimize the conversion rate.
Retention Analysis
Analysis that helps us improve customer loyalty, reduce churn, and increase revenue by identifying and addressing the root causes of customer attrition.
- Events
- Fields
- Measures
- Cohorts
๐จโโ๏ธ๐ฉโโ๏ธOnboarding AB Test Analysis๐จโโ๏ธ๐ฉโโ๏ธ
๐งช๐ ฐ๏ธ๐๐ ฑ๏ธ We had a total of 13,000 users who were part of the experiment. With a total of about 10k in the control group vs. 2,500 in the variant group.
โ Looking at our conversions we actually experienced a slightly lower conversion rate for users who were singing up or purchasing a subscription.
๐งช I ran a significance report against a previous test we had where the variant received a lift of more than 56%. @Richard Fields We need to have a discussion on this item here?