October 21, 2025

How to A/B Test a Product Page in Shopify

Arrow pointing left
back to blog
|Ottorbox shows how to use a related products section to increase AOV.|Open the Shogun app.|Select “Pages & templates”.|Select the product page you want to experiment with.|Select the lab beaker icon in the top-right corner of your screen.|Select “Turn on A/B testing”. |Select “Next: manage variants”.|Select “Next: Edit variant designs”. |Use the tabs to select which variant of the page you’re editing.|Shogun provides you with a wide variety of tools for creating custom Shopify pages.|The Collection element pulls data directly from your Shopify store. |Select “Publish test…”.|Select “Publish test now”. |Select “End test now”.|Select “End test and publish”.  

about

This guide covers everything Shopify merchants need to know to start A/B testing their product pages.

the author

Phill Moorman
VP of Marketing

share this post

Usually, when you make a decision, there’s no way to really know what would have happened if you went the other way. All you can do is pick a path and hope for the best.

In ecommerce, this isn’t the case. 

A/B testing allows you to try out two different versions of the same page at the same time. Here’s how A/B tests work — after you’ve made some changes to a page, some visitors will be randomly directed to the original version, while others will be randomly directed to the updated version.

That way, you’ll be able to objectively determine whether your changes are having their intended effect.

In this guide, we’ll show you everything you need to know to set up A/B tests for your Shopify product pages. With the help of an ecommerce A/B testing tool, it’s really not that complicated.

In this post, you will learn:

The benefits of product page testing in Shopify

There are many ways that A/B testing can be used to benefit your Shopify store:

  • Discover how you can change the design or functionality of your Shopify product pages to increase your conversion rate
  • You can also figure out ways to improve metrics such as average time on site and bounce rate, which in turn will help you rank higher on search engine results pages
  • Roll out new page design concepts in a controlled way to reduce risk

Use A/B testing to optimize your Shopify storeShogun’s A/B testing tool is both powerful and easy to use Get started now

Ecommerce is a zero-sum game.

If a prospect lands on one of your product pages only to quickly back out, there’s a good chance you’ll lose them to a competitor — maybe forever.

And you can bet that your competitors are doing everything in their power to make sure they don’t lose any potential customers to you.

Continuous A/B testing will allow you to keep finding new ways to improve your product pages and stay one step ahead of the competition.

Also, consumer behavior isn’t static. What once worked for your Shopify product pages may now be ineffective.

By continuously testing your Shopify product pages, you can quickly identify new trends in visitor behavior, respond to changing tastes, and avoid becoming outdated. 

Ideas for your first test

You certainly don’t need to be a professional web developer to take advantage of A/B testing. Here are a few ecommerce A/B testing ideas that anyone can try out to see if they move the needle on their product page’s conversion rate or other performance metrics:

  • Use a visual element to highlight that an item is on sale, such as a strikethrough text effect on the original price next to the new sale price
  • Add a banner that calls out free shipping is available
  • Add a collection of related products to the page — this will often end up increasing your average order value (AOV)

Completing one of these relatively easy A/B tests will allow you to quickly get a win on the board, giving you the confidence to take on more extensive, continuous testing in the future. 

Ottorbox shows how to use a related products section to increase AOV.

Setting up a product page A/B test in Shopify using Shogun (step-by-step)

Let’s go through that last example — seeing what happens when you add a collection of related products to a product page — to show you exactly how to set up your own experiment with Shogun A/B Testing

Step 1. After downloading and installing Shogun A/B Testing, open the app and click on the “Create test” button. Then, select the “Page test” option. 

Select the "Page test" option.

Step 2. Select the page you want to experiment with in the “Original” section of the test settings. Then, click on the “Copy original” button in the “Variant” section to duplicate the design of the page.

Select "Copy original".

Step 3. You’ll find that you can make changes to your new variant directly through Shopify’s built-in theme editor — conveniently, Shogun doesn’t require you to learn how to use any third-party design tools to set up your experiments.

The theme we’re using for our store comes with a related products section, so we can just add this feature to our new variant with a couple of clicks.

Shogun A/B Testing allows you to customize page variants directly through Shopify's built-in theme editor.

Step 4. Select a goal for your experiment. There are pre-set options such as conversion rate, add-to-cart rate, and average order value, and you have the ability to set up a custom event to track as well. 

Choose a goal for your experiment.

You can also determine how the percentage of traffic is split up between the original version and the new variant, and you can target your test to a certain segment of your visitors if you like (custom audiences can be built based on factors such as where the visitor is located, whether they’re a new visitor or a returning visitor, what type of device they’re using, etc.).

Step 5. Whenever you’re ready, click on the “Review” button and then confirm that you want to start your test.

Confirm that you are ready to start your test.

Step 6. After publishing your test, you can see how both the original version and the new variant are performing in real-time. 

Shogun A/B Testing makes it easy to evaluate the results of your experiment.

Shogun will also show you when the results of your test have reached statistical significance, so you’ll know when you’ve collected enough data to confidently conclude your experiment. Then, you’ll be able to make a highly informed decision about whether you should stick with the original version or fully switch over to the new variant.

Overall, Shogun A/B Testing makes it especially easy to conduct your own ecommerce experiments and figure out what it takes to improve your product pages.

Merchants that have achieved big results with A/B testing

We’ve already gone over the many benefits of Shopify A/B testing — and you don’t need to just take our word for it. Countless ecommerce merchants have shown that A/B testing produces significant results, such as:

  • The Ridge, which primarily sells high-end wallets, tested out a banner and call to action on their homepage that led visitors to a page explaining the benefits of their products. This change led to a 15% increase in their conversion rate and $2.5 million in additional revenue.
  • The luggage and apparel brand Swiss Gear felt their product pages were a bit too cluttered, so they ran an A/B test on a more streamlined design, which resulted in an overall conversion rate increase of 52% (and an increase of 137% during the holiday season).
  • The writing guide service WriteWork used A/B testing to perfect their CTA buttons and other elements of their product page design, leading to a 144% increase in their clickthrough rate and a 50% increase in sales.

Shogun is natively integrated with the Shopify platform — unlike many other Shopify A/B testing tools, you can simply install Shogun directly onto your store rather than setting up the integration by manually editing your site code.

Use A/B testing to optimize your Shopify storeShogun’s A/B testing tool is both powerful and easy to use Get started now

You might also enjoy

Get started for free

Get hands on with everything you need to grow your business with a comprehensive suite of tools.
Start now
Arrow pointing up and to the right Arrow pointing up and to the right