Academy / A/B Testing Fundamentals

Decide, document and share

Use guardrails and a pre-agreed rule to decide whether to ship, stop or iterate, then record the result in a one-page report and a searchable repository.

• Build a metric system with one primary metric, a few secondary metrics and three to five guardrails with harm thresholds
• Decide whether to ship, stop or iterate using trust checks, guardrails and the primary metric's interval
• Write a one-page test report and file it in a searchable repository with consistent tags