PremiumEmail Triage Automation
- 阅读完整会话
- 分入 3 个类别
- 以你的语气起草
- 批准后发送
← 全部 Skills · 自动化 · A/B Test Planner

Premium
Premium
Free
Premium此 Skill 产出的示例。示例内容,仅供说明。
A/B Test Plan — sample Metric: Signup start rate | Baseline: 5% | MDE: +20% relative (+1.00 pp) | Arms: 2 (Control + 1 variant) | Confidence: 95% | Power: 80% Sample size: 8,160 per variant | 16,320 total | About 9 days at 2,000 visitors/day (50/50 split) Decision rule (pre-registered): call the test only when the smallest arm reaches 8,160 visitors; a variant wins only if it beats control by at least 1.00 pp and the difference is significant at 95% confidence. A significant result smaller than the MDE is real but too small to ship on this hypothesis. An inconclusive result is not a reason to extend the test — plan a new one. Sample sizes are planning estimates from the normal approximation at the stated confidence and power — not a guarantee, and this script does not analyse results.
我们想在 BeanLoop 定价页测试把注册 CTA 移到首屏上方——开测前先把方案定下来。Read https://skillu.dev/install/agent.md, then install the A/B Test Planner skill (ab-test-planner)./ab-test-planner,然后用大白话描述你想要什么。不是。它只说明方案的每一部分都齐全、输入没有错误——方案完整,不等于结果。多数测试会输或打平;一份直说这一点的方案正在尽职。
因为相对提升小,绝对差异就小——5% 基准上提升 20% 只有 1 个百分点,要可靠地区分 5% 与 6%,每组大约需要 8,160 名访客。MDE 减半,样本量大约翻四倍。