Last updated Oct 11, 2024

Create a multivariate test

Create a page multivariate test

1. Log in to my.rokt.com, and click on your account on the Home page.
2. Click Transactions.
3. Click Experiments.
4. Click Add experiment.
5. Enter an experiment name.
6. Select Page Multivariate Experiment as the experiment type.
7. Click Continue.
8. Enter a hypothesis.
9. Select a Primary metric.
10. Optional Select a Secondary metric.
11. Select the Page you’d like to test.
12. Click Next.

Design variants

The next step is to define the experiment variants that will validate or invalidate your hypothesis. It’s important to always ensure there is a baseline in place (known as a control) that will act as a point of comparison for any results you receive from your experiment. Below are some rules which guide best practice when designing your variants:

1. Only test one element at a time: So that you know what change is responsible for the results you are seeing. This helps you to build an understanding of how different elements influence customer behaviour, once you’ve got a good picture you can focus your experiments on the most impactful elements.
2. Set up control and treatment: Retain a version of your original creative in the experiment, this is your control. The new variations you are testing are called treatments. These are challenger variants you want to test against your control.

You can create up to five variants to test against your original page experience. To get started, select a control variant from the list. This is an existing variant on the page which will be involved in the experiment.

Once you’ve selected your control, create test variants by changing one thing about your experience. This can be the layout design, layout, location, or offer combinations.

note

If you’re changing something about the layout design or the types of offers that are allowed to show on your page, you’ll need to create new layouts and/or establish different campaign control rules before building your experiment and adding variants.

See How to create a layout for more information.

Configure your test variants

1. Click anywhere in the variant section for Variant 1.
2. Enter a Variant name.
3. Select one or more layout and input a Target element (this step is only required for embedded layouts).
4. To create multiple variants, click New variant in the variant tab section.
5. Once you’ve finished designing all of your treatment variants, click Next.

Set traffic allocation

The traffic allocation step is used to define how many of your customers you wish to include in your experiment. Enter a numeric value or use the slider to specify the percentage of all customers visiting the page to include in your experiment cohort.

Variant distribution

Distribution refers to how the allocated traffic should be split between each of the test variants in the experiment. All variants are weighted equally by default. A customer who is included in your experiment has an equal chance of seeing any of your variants.

Start your experiment

Click Start experiment when you’re ready for your customers to see the experiment. When the status field says Live, your experiment is running on the page. Most experiments will be live within 5 minutes.