PinnedPublished inThe StartupWhen to Stop A/B Experiments EarlyLet’s talk about decision processes for stopping A/B experiments early.Nov 30, 2020Nov 30, 2020
PinnedPublished inUX CollectiveWhy your company should be experimentingI was recently approached by a client who needed to explain the benefits of experimentation to his company. My first thought was an…Feb 6, 2021Feb 6, 2021
PinnedPublished inUX Collective8 powerful levers for conversion rate optimisationConversion Rate Optimisation can be a wildly chaotic exercise — like blindly throwing hundreds of darts hoping that something lands on a…Aug 13, 2020Aug 13, 2020
PinnedPublished inTDS ArchiveThe essential guide to Sample Ratio Mismatch for your A/B testsIf you can’t trust the result of an experiment, you can’t trust the decisions you make based on it; and you’d be surprised how often you…Jul 22, 20212Jul 22, 20212
PinnedPublished inTDS ArchiveWhat comics can teach us A/B experiment analysisTelling the story of risk, reward and certainty using the principles of comic panel transitionsMar 2, 20211Mar 2, 20211
Published inTDS ArchiveSample Ratio Mismatch: So many questions. How to answer them?Nothing deflates an A/B testing program quicker than data validation issues — and SRM is one of the most damaging. But how accurate is…Apr 20, 20221Apr 20, 20221
3 Essential Productivity Hacks To Live ByHow I hacked my routine to increase productivity and wellbeingApr 22, 2021Apr 22, 2021
Published inTDS ArchiveHow to analyse A/B experiments using bayesian “expected loss”A how-to guide to calculating Bayesian Expected Loss for your experimentApr 16, 20212Apr 16, 20212
The US Election 2020 and the dangers of “peeking” too early on experiment resultsIt’s 08:41 a.m. on 6 November 2020. I have a browser tab open to a map of the 2020 US Election results, and I’m thinking about the…Nov 6, 2020Nov 6, 2020
