Module 6 of 8

Implementation

Testing tools, QA, flicker, rollout and writing results up so others can trust them.

Lessons

1. 1

   Choose an experimentation approach

   Pick a test design that fits the question

   Coming in a monthly release

2. 2

   Client-side versus server-side testing

   Choose where a test runs

   Coming in a monthly release

3. 3

   Feature flags and allocation

   Allocate traffic safely with flags

   Coming in a monthly release

4. 4

   Instrumentation and exposure logging

   Log exposure so analysis is valid

   Coming in a monthly release

5. 5

   QA and accessibility checks

   QA variants for function, tracking and accessibility

   Coming in a monthly release

6. 6

   Performance and flicker

   Prevent flicker and performance regressions

   Coming in a monthly release

7. 7

   Safe rollout and monitoring

   Roll out with guardrails

   Coming in a monthly release

8. 8

   Write a reproducible experiment readout

   Write a readout others can audit

   Coming in a monthly release