A/B Testing

The Basic Idea

If you run an online store and want to increase sales, you might think about redesigning your product page. But you’re not sure where to start. Do you rewrite the product description? Upload fresh product photos? Change the size and color of your “add to cart” button? Making all these changes at once is a lot like experimenting with a recipe without tasting it along the way. Perhaps it turns out great, or maybe it’s a total disaster. Either way, you’ll never know what caused the outcome.

With A/B testing, you can measure the impact of each individual change on user behavior. You will learn what works and, just as crucially, what doesn’t. For example, you might discover that changing your product photos improves conversion rates, but writing new product descriptions has the opposite effect.

A/B testing is a method for comparing two versions of a webpage, app, email, or advertisement to determine which one performs better. It’s also called “split testing” because it involves splitting your audience into two groups and showing them the different versions (called variants) of whatever it is you’re testing. One group views variant A, and the other views variant B. By comparing how these two variants perform, you can easily see which performs best.

A mistake that some companies make is to start moving a bunch of levers around without clear planning upfront for what they're trying to optimize—and what will be impacted by those changes.


- Dan Siroker, author of A/B Testing: The Most Powerful Way to Turn Clicks Into Customers

About the Author

Smiling woman with long hair stands in front of a lush plant with pink and yellow flowers, near what appears to be a house exterior with horizontal siding and a staircase.

Kira Warje

Kira holds a degree in Psychology with an extended minor in Anthropology. Fascinated by all things human, she has written extensively on cognition and mental health, often leveraging insights about the human mind to craft actionable marketing content for brands. She loves talking about human quirks and motivations, driven by the belief that behavioural science can help us all lead healthier, happier, and more sustainable lives. Occasionally, Kira dabbles in web development and enjoys learning about the synergy between psychology and UX design.

About us

We are the leading applied research & innovation consultancy

Our insights are leveraged by the most ambitious organizations

Image

I was blown away with their application and translation of behavioral science into practice. They took a very complex ecosystem and created a series of interventions using an innovative mix of the latest research and creative client co-creation. I was so impressed at the final product they created, which was hugely comprehensive despite the large scope of the client being of the world's most far-reaching and best known consumer brands. I'm excited to see what we can create together in the future.

Heather McKee

BEHAVIORAL SCIENTIST

GLOBAL COFFEEHOUSE CHAIN PROJECT

OUR CLIENT SUCCESS

$0M

Annual Revenue Increase

By launching a behavioral science practice at the core of the organization, we helped one of the largest insurers in North America realize $30M increase in annual revenue.

0%

Increase in Monthly Users

By redesigning North America's first national digital platform for mental health, we achieved a 52% lift in monthly users and an 83% improvement on clinical assessment.

0%

Reduction In Design Time

By designing a new process and getting buy-in from the C-Suite team, we helped one of the largest smartphone manufacturers in the world reduce software design time by 75%.

0%

Reduction in Client Drop-Off

By implementing targeted nudges based on proactive interventions, we reduced drop-off rates for 450,000 clients belonging to USA's oldest debt consolidation organizations by 46%

Read Next

Notes illustration

Eager to learn about how behavioral science can help your organization?