Last modified March 21, 2019 by John Mcgrath

How do I A/B test localized push notifications?

If you use the Localize feature when creating your push notifications, you cannot A/B test the same campaign. However, you can split up your user base with Swrve’s A/B test Resources tool, and then use those segments in different localized push campaigns to A/B test different push notifications.

How to create push notifications for each variant

Step 1: In the Campaigns center, select Create campaign.

Step 2: On the Choose your marketing channel screen, select Push as your campaign channel, Standard push as the Notification type, and then select Continue.

Step 3: Complete the Overview and Add Content screens of the push notification workflow (for more information on completing these screens, see Creating push notifications and Localizing push notifications).

Step 4: On the Set Target screen, under the Define Target Audience section, select Custom Audience and then define the following values:

  • Under User Profile Filters, select Resource Tests.
  • Select the test from the list of available resource A/B tests.
  • In the next list, select have been exposed to.
  • Select one of the two variants you created (for example, Activities Page).
  • To add the audience filter, select Apply filter.

A/B test localized push

Step 5: In the Select Campaign Goals section, select any additional campaign goal you want to track.

Step 6: Select Save as Draft: Preview & Test to proceed, and then schedule the launch and timing of the campaign as required.

Step 7: Create and launch another push notification campaign. Follow the same steps, but this time use the variant you didn’t use in Step 4 (Messages Page).

Step 8: After users have had a chance to engage with the app, return to the Resource A/B Testing screen and select the A/B test you created to compare how each of the variants are performing.

Resource A/B test details for localized push campaign