Managing Experiments

Before using experiments, learn how you can work with Iterable's experimentation UI to find information about the experiments you create.

# In this article

# Accessing experiments

To browse experiments, sign in to Iterable and navigate to Messaging > Experiments.

On the Experiments page, you can:

• Create a new experiment.
• Edit or delete an existing experiment.
• View details about a specific experiment, including the control campaign and associated variations.
• View the criteria used to select a winning campaign.
• View the status of an experiment.
• Review when the experiment started and ended.
• Find out who created an experiment and when, by hovering the date under Last modified.
• Find out who last modified an experiment and when, using the avatar under Last modified.

To display more information about a specific experiment, click the experiment’s name to open the Experiment Analytics page.

# Experiment statuses

The status reported on the Experiments page provides important information about the state of a campaign and the variations being sent to users in an experiment.

• Draft - An experiment has been created, but not launched.

  For blast campaigns, if the campaign is scheduled, the experiment will automatically launch when the campaign is sent. If not, it will be sent with the campaign once you schedule it.

  For triggered and journey campaigns, if the campaign is active, the experiment will automatically launch when the campaign is sent. If a campaign isn't active, you'll need to manually launch the associated experiment after you activate the campaign.

• Running - Iterable is still waiting for a winner to be declared. Campaigns have only been sent to the subset being used for testing.

  If the experiment was configured to have Iterable select a winner, Iterable is still waiting for the experiment test duration to complete (blast) or for the minimum number of sends per variant to be met (triggered).

  If the experiment was configured to manually select a winner, Iterable will continue testing all variants until a winning variant is manually selected or the experiment is ended.

• Finished - Either Iterable or a user has ended the experiment and variants are no longer being tested. If a winning variant was found and the associated campaign is still running, all future users will receive that winning variant. If no winning variant was found and the associated campaign is still running, all future users will receive the control variant.

• Winner found - The experiment is still running and Iterable is using a multi-armed bandit approach to pick a winning variation. To optimize your experiment, that variation is sent to 90% of your campaign's future sends, with the other variations being sent to the remaining 10%. Iterable continues to monitor variations for the duration of the experiment, selecting a new winner if new user preferences surface. If a new winning variant is found, it becomes the current winner, and 90% of new users will start to receive that variant.

# Sorting experiments

To sort your project's experiments by name, status, launch date, or last modified date, click the column headers on the table.

# Searching for an experiment

Type an experiment's name or ID in the search bar in the upper-right corner of the page. The experiments list will automatically refresh to show experiments that match your search phrase.

# Filtering the experiments view

To filter your experiments by status, choose one of the status filters along the top of the page. Alternatively, to filter by other criteria, click Filters and select relevant criteria. Options include:

• Experiments - Modified by, Test subject, Winning criteria, Winner selected, and split variations

• Campaigns - Campaign type, Campaign medium, Campaign label

# Viewing experiment analytics

Once an experiment has finished, review its analytics for insight about how users responded to the variations you tested.

To view the analytics associated with an experiment, navigate to Messaging > Experiments and click the experiment you're interested in.

On this page, you can:

• View details about the experiment and the associated campaign.
• Select and view performance-related analytics.
• Export the test metrics to a CSV file.
• End or delete experiments and variations.
  • To use the control for all remaining sends (after the test period), click End Experiment
  • To end an experiment and use a particular variation for all remaining sends, click Use Variation.
  • To delete poorly performing variations and add new variations, click Edit.
• Select a variation to use and end the experiment (active campaigns only).