Test, Learn, Optimize
Your resource to smarter customer experiences
Category
Fifteen years ago, we started building Conductrics to give teams a better way to run experiments. A lot has changed in the industry since then. To mark this milestone, we are reflecting on where the market is heading today, looking…
Overview At Eurostar, every high-speed train runs on innovation and customer service, and every journey begins with a booking. Shouldn’t the online booking process be just as smooth and friendly? Eurostar partnered with Conductrics Experimentation to innovate their booking and…
Overview Sanoma Media is a leading Finnish media company, reaching nearly all Finns every week through print, radio, and their streaming service, Ruutu. They are a pioneer in the digital transformation of media and have the country’s most diverse media…
The benefit of using Regression Adjustment (CUPED) for A/B Testing is that in certain cases it can increase the precision of the experiment’s results. However, if one isn’t intentional in the design and set up, this more powerful approach can…
Seemingly simple ideas underpinning AB Testing are confusing. Rather than getting into the weeds around the definitions of p-values and significance, perhaps AB Testing might be easier to understand if we reframe it as a simple ruling out procedure. Ruling…
As AB testing becomes more commonplace, companies are moving beyond thinking about how to best run experiments to how to best set up and run experimentation programs. Unless the required time, effort, and expertise is invested into designing and running…
How often is A/B testing reduced to the following question: ‘what sample size do I need to reach statistical significance for my AB Test?’ On the face of it, this question sounds reasonable. However, unless you know why you want…
I was talking with Kelly Wortham during her excellent A/B testing webinar series. During the conversation, one of the attendees asked if they just wanted to pick between A and B, did they really need to run standard significance tests…
