Intelligems enables your organization to run real-time split tests on your store's prices. This article will walk you through how to run a price test with Intelligems, as well as some best practices to keep in mind.
In this article:
- Video Walkthrough
- Step 1: Create a new test.
- Step 2: Choose your products.
- Step 3: Create your test groups.
- Step 4: Set the test prices.
- Step 5: Configure advanced settings.
- Step 6: Save your test.
- What happens next?
Video Walkthrough
Step 1: Create a new test.
Navigate to the 'A/B Tests' tab in the menu on the left-hand side of the Intelligems portal. Once there, click 'Create New Test' above the experiments table. Select 'Pricing Test' and 'Create New Test.'
Step 2: Choose your products.
Select which products you want to include in the test by checking the boxes to the left of each product.
A few tips and tricks:
-
You can also select all products if you'd like to test your whole store, or all products matching the filters you have set up, by using the select all box at the top left-hand side of the table. Once you click the select all box, you will also need to click 'Select all 20+ products in your store'.
❗If you have subscription products, you may be missing the select all checkbox! Please reach out to support@intelligems.io for assistance with this.
- Use the search bar at the top of the table if you are looking for a specific product!
- The filter drop downs to the left of the table are helpful when looking for specific vendors, tags, product types, or statuses.
✨ If you have 250+ Product Types, Vendors or Product Tags set up in Shopify, Shopify will not allow us to load them all. In this case, you can use the search bar in the Intelligems app to filter instead. For example, if you were looking for all products with the product tag 'Test', you would want to search for 'tag:Test'. For product type, you would use 'product_type:Test' and for vendor, you would use 'vendor:Test'. Please reach out to support@intelligems.io if you have any questions on this!
Step 3: Create your test groups.
Fill in the Test Name and Test Description for the experiment you are creating.
✨Put some detail in the description! Tests can be live for several weeks, and people do sometimes forget how they set things up 🙂
Add new groups to include in the test by clicking on the ‘+’ button. Name the groups for the experiment and use the slider to allocate what percentage of traffic will go to each group. Click ‘Continue’ when you are done.
❗Number of test groups is limited to five for our Sapphire and Diamond Plans and is unlimited for our Plus Plan.
✨The more groups you have, the longer it will take to get statically significant results. You’ll need >100-200 orders for each group in the test to be confident in the results.
Step 4: Set the test prices.
There are three different options for filling in your prices:
- Uploading a spreadsheet is best suited for cases where you have already set up your prices in a CSV or Excel file.
- Autofill is best suited for cases where you want to test uniform changes to all products in the test, such as a 10% or $10 dollar increase and decrease across all test products. Autofill is based on the control group product prices that are pulled in from Shopify.
- Manual set is best suited for cases where you'd like to configure the prices for each product separately, such as a $10 increase to Product A and a $5 increase to Product B.
✨There are two relevant fields for each entry:
- Price: The price of the product; this is the price the user will actually be charged when they purchase the product in the given test group, before any discounts.
- Compare Price: Also known as the 'compare at price', this price will be shown as a strikethrough. This field is optional and there is no need to populate the 'Compare Price Field' if you do not wish to show a strikethrough. Your theme must be configured to show strikethroughs in order for Intelligems to display one.
Uploading a spreadsheet.
To upload a spreadsheet, first click on the 'Upload CSV / Excel' button in the top right, and then download one of our templates where you will populate prices if needed. Once you select 'Download CSV template' or ' Download Excel template', your download will start automatically.
Using Microsoft Excel, Google Sheets, Numbers, or another spreadsheet editing tool, manually input the prices for the test groups and save the file with a .csv, .xls or .xlsx extension.
✨ The following fields (columns) are required in the uploaded file.
- product_title
- product_id
- variant_title
- variant_id
- handle
- Price - [Test Group Name] (for each test group)
- Compare Price - [Test Group Name] (for each test group)
The rest of the fields in the template are provided for reference and are not required.
Back in the Intelligems app, click the 'Upload CSV / Excel' button at the top again followed by 'Upload CSV or Excel' and select the saved .csv, .xls or .xlsx file. Once it has uploaded, click 'Continue'.
Autofill.
Click 'Apply Autofill' in the top right.
Configure the percentage or dollar amount change for each group and whether the change should be an increase or decrease relative to the control, as well as whether the amount should be rounded. Note that increase / decrease, the amount and % / $ selector are three separate fields. Click 'Apply All' when you are done.
Manual set.
Input the prices and 'compare at' prices (if desired) for each product and test group. Once you've populated prices for all products in the test, click 'Continue' at the bottom of the page.
✨ You can expand all rows or collapse all rows by pressing 'Expand All' or 'Collapse All' at the top left of the table.
Step 5: Configure advanced settings.
There are two advanced settings steps, both of which are optional to set up.
The first is Audience Targeting. This tool allows you to include, exclude or assign specific treatment to certain traffic for your test. Check out this article for more information on configuring this option.
The second is Find & Replace. This tool allows you to adjust site copy for site visitors based on their test group. Check out this article for more information on configuring this option.Step 6: Save your test.
Once you have completed all the above steps, you will be able to save your test with the button in the bottom right.
❗Don’t worry, this won’t set the test live yet and you can come back and edit if you need to make changes!
What happens next?
Now that you've created your price test, here are some things to do next: