Roll out to 50%
Keep checklist visible, but reduce pressure around data-source connection.
Experiment readout2026-05-06 → 2026-05-20Owner: Growth PM
Directional, no p-value yet
Decision
Iterate and ship to 50%.
The onboarding checklist increased 7-day activation by 5.5 absolute points, mostly through teammate invites. The data-source step created support friction and should be softened before full rollout.
Primary metric
+5.5pp
Activation within 7 days: 21.4% → 26.9%
Hypothesis
A guided checklist will help new teams invite teammates and complete a first shared workflow.
Audience
New workspaces with 2-20 invited users.
Guardrails
Support tickets rose from 6.2 to 7.1 per 100 workspaces; deletion stayed flat.
Metric table
| Metric | Control | Variant | Read |
|---|---|---|---|
| Activation | 21.4% | 26.9% | Positive signal |
| Invite teammate | 38.1% | 47.4% | Largest movement |
| Create workflow | 44.8% | 46.1% | Minor lift |
| Support tickets / 100 | 6.2 | 7.1 | Watch |
| Workspace deletion | 4.8% | 5.0% | Flat guardrail |
Activation funnel movement
Control activation21.4%
Variant activation26.9%
Control invite38.1%
Variant invite47.4%
Split data-source step
Add "skip for now" and "connect later"; engineering estimates 2 days.
Calculate significance
Add p-value or Bayesian read before 100% rollout.