SimGym

You can use SimGym, an app by Shopify, to test your online store with AI shoppers before you publish changes to your theme. The AI shoppers behave the way real customers do: they browse collections, view products, add items to their cart, and describe their experience.

You can test a single theme, or compare two themes to find out on which theme the AI shoppers are more likely to add products to their cart. After a simulation completes, you get recommendations for changes to make to your store, along with the shopper feedback behind each recommendation.

Eligibility

To use SimGym, your store must meet the following requirements:

  • Your store uses a Liquid storefront. Hydrogen and headless storefronts aren't supported.
  • Your store has Shopify Network Intelligence (SNI) activated.
  • Your online store doesn't use a permanent password page, such as on some development stores. Stores in private mode can still run simulations, including during a free trial.
  • Your store has an active plan.
  • Your store has at least one product that's published to the Online Store sales channel, isn't a gift card, and has a price above zero.

If your store doesn't meet these requirements, then SimGym explains why you can't start a new simulation. For an inactive plan, deactivated SNI, or no eligible products, a banner links to where you can resolve the issue. If your online store uses a permanent password page, then you can't use any part of SimGym.

Limitations and considerations

Consider the following limitations when using SimGym to simulate shopper behavior:

  • Theme comparisons require at least one draft theme.
  • Simulations work best for stores with existing products and content.
  • Simulations use AI shoppers that mimic customer behavior, but results might differ from how your actual customers behave.
  • Bot protection or traffic limits can block AI shoppers from accessing your storefront and leave their shopping journeys incomplete.

Pricing

SimGym includes a monthly allowance that renews on the first day of each month. Unused simulations don't carry over to the next month.

Simulations with the Entire shopping journey, Product discovery, or Add-to-cart confidence test focus are single-theme simulations. A theme comparison normally uses twice as much of your monthly allowance as a single-theme simulation.

After you reach your monthly usage limit, you can keep running simulations at these prices:

  • Single-theme simulations: $0.75 USD
  • Theme comparisons: $1.50 USD

SimGym displays the exact price before a paid simulation starts. You can approve the price to continue, or cancel without a charge.

SimGym uses any available monthly allowance first. You're only charged on your Shopify bill when an additional paid simulation completes successfully.

Before you begin

Before you start using SimGym, ensure your store meets the following requirements:

  • Your store has at least one product that meets the eligibility requirements.
  • For theme comparisons, your store has at least one draft theme in addition to your published theme.

Installing SimGym

Install SimGym from the Shopify App Store to start simulating AI shoppers on your store.

Steps:

  1. Install the SimGym app from the Shopify App Store.
  2. From your Shopify admin, go to Apps > SimGym.
  3. Start creating simulations.

Simulations

A simulation is a session where AI shoppers interact with your store. When you create a simulation, you can choose one of the following test focus options:

  • Entire shopping journey: Test your store from start to finish to find the biggest points of friction.
  • Product discovery: Test whether browsing your home page and collections leads AI shoppers to a relevant product.
  • Add-to-cart confidence: Test whether your product details give AI shoppers the confidence to buy.
  • Theme comparison: Test two themes with the same AI shoppers to find out how they compare.

Common use cases for simulations

Review these common use cases for SimGym simulations:

  • Theme changes: Compare your published theme to a new theme before publishing it. This is the primary use case for SimGym.
  • Seasonal updates: Test holiday themes or promotional layouts before campaign launches.
  • Store navigation: Compare different theme-based menu structures or collection organization.
  • Store audit: Run an Entire shopping journey simulation to get a detailed review of your current storefront without setting up a comparison.
  • Draft theme review: Test a draft theme before publishing to catch issues early.
  • Focused feedback: Use the Product discovery or Add-to-cart confidence test focus to concentrate on how AI shoppers find products or decide to buy.
  • Before-and-after: Run a simulation on your current theme, make changes, and then run another simulation to tell if the experience improved.

Tips for successful simulations

Consider these tips to improve your simulations:

  • Test one change at a time: This makes it easier to understand what caused any differences in shopper behavior.
  • Review individual shoppers: Use View findings to read the shopper feedback and session replays behind a recommendation and understand behavior patterns.
  • Test before major changes: Run simulations before implementing significant updates to your published theme.

Running a simulation

Create a simulation by selecting a test focus and the themes to test. A single-theme simulation is usually named after its test focus and theme, such as Entire shopping journey: Dawn. A theme comparison is named after both themes. You can rename a simulation after you create it.

Steps:

  1. From your Shopify admin, go to Apps > SimGym.

  2. If you've run a simulation before, then click Create simulation. If this is your first simulation, then continue on the SimGym home page.

  3. In the Test focus section, select Entire shopping journey, Product discovery, Add-to-cart confidence, or Theme comparison.

  4. Select the themes to test:

    • For a single-theme simulation, your published theme is selected in the Theme to test section. To test a draft theme instead, change the selected theme.
    • For Theme comparison, your published theme is selected as Theme 1. If Theme 2 is empty, then select a draft theme. To compare different themes, change either theme. Theme 2 must be a draft theme.
  5. Click Run simulation.

During the simulation, an animated preview of your storefront is displayed. Simulations usually take 1–5 minutes. You can leave the page. When a simulation completes successfully, you receive a notification in your Shopify admin with a link to the results.

Viewing simulation analysis

After your simulation completes, you can review the analysis to understand how the AI shoppers interacted with your store and what to change.

Steps:

  1. From your Shopify admin, go to Apps > SimGym.

  2. Click a completed simulation to view the analysis.

  3. Optional: To review the shopper feedback behind a recommendation, click the recommendation, and then click View findings.

Results for a single-theme simulation include the following sections:

  • Key finding: This section describes the most important result from the simulation.
  • Storefront screenshots: This section includes screenshots of the pages that the recommendations apply to, when screenshots are available. Numbered markers on the screenshots match the numbered recommendations, so you can find where each change applies.
  • Recommendations: Sidekick, the Shopify AI-powered commerce assistant, turns the AI shopper feedback into actionable changes to make to your store.

Results for a theme comparison start with a Summary of whether the AI shoppers were more likely to add to cart on one of the themes, or added to cart at the same rate on both themes. Sidekick also writes the recommendations for each theme, which are listed next to a screenshot of the theme's home page, when one is available.

When you click View findings on a recommendation, the AI shoppers who encountered that issue are listed with a summary of their experience. You can play a shopper's session replay, and click the timestamp of a shopper's thought to jump to that moment in the replay.

You can also rate whether the recommendations were helpful and add a comment.

Simulations that completed before the current version of SimGym keep their original results layout.

Managing simulations

Use these settings to manage your simulations:

  • View simulation history: View all past simulations and their analyses on the SimGym home page. To find a simulation, enter its name in the Search simulations field.
  • Rename simulations: Open a simulation, click Actions > Rename, enter a new name, and then click Save.
  • Delete simulations: Open a completed simulation, click Actions > Delete, and then click Delete simulation. To stop a simulation that's running, delete it from its progress page.

Understanding AI shopper feedback

AI shopper feedback describes what the shoppers encountered during a simulation. For the shopper summaries and session replays behind each recommendation, refer to Viewing simulation analysis.

Use this feedback to identify patterns across multiple shoppers. If many shoppers report similar issues, then those areas might need attention. To act on a recommendation, you can edit your theme to address the areas that AI shoppers flagged.