Setting up and running an A/B test campaign
- Navigate to the Campaigns page.
- Click on the ‘Create Campaign’ button.
- On the plan page, check the ‘A/B test’ checkbox and fill out the remaining fields.
- Click on the ‘Next’ button.
- On the build page, fill out the two variations of the campaign message you want to send out.
- To set up an SMS message, simply add in your message.
- To set up an MMS, click on ‘Select Media’ and upload the file and the system will automatically convert it to an MMS message.
- To set up an SMS message, simply add in your message.
- To include links in your message, select the ‘link’ custom data point and check the ‘Enable click tracking’ checkbox. Follow the remainder of steps and review the phone preview to ensure the correct short link was selected.
- To view the message variations side by side, click on the ‘Compare messages’ icon in the upper right corner.
- Before running the A/B test, you can send out preview or internal test messages to any test contacts available for the client. Simply select from the available numbers and click the ‘Send Test Message’ button.
- Please note: the test message will be sent out for whichever message version you are currently on (A or B).
- Once you are ready to run the AB test, enter the percentages you want each variation to be sent to and click the ‘Run a/b test’ button.
- Please note: you need to have a value greater than 0 in each message group size field. And the total percentage can’t exceed 40% of the selected contacts. You will need to adjust the percentages in order to proceed
- Please note: you need to have a value greater than 0 in each message group size field. And the total percentage can’t exceed 40% of the selected contacts. You will need to adjust the percentages in order to proceed
- Review the percentage breakdown and confirm that you are ready to run the a/b test.
- Please note: once the A/B test begins, you will no longer be able to make any edits to the campaign.
- Once the A/B test is started, you will see the progress bar as well as statistics for each variation. The progress bar will fill out once the system starts sending the messages.
- Please note: this will behave as any regular campaign and will need to go through scheduling and sending. Depending on the size of the test group, this may take several minutes.
- The deliverability data will start populating once we start receiving it from our providers.
- Please note: this data is refreshed every minute and may take several minutes to update.
- If you want to end a/b test earlier, you can click the ‘End test’ button. This will stop any remaining messages from being sent out.
Promoting the winning campaign
- Open the A/B test you want to promote.
- Navigate to the build page.
- Click the ‘End Test’ button.
- Select the winning message and click the ‘Save & Execute’ button.
- Review and confirm start and end date/time for the winning campaign.
- Once confirmed, the system will create the campaign and will schedule messages according to the start date/time.