A/B Theme Test add-on displays two different Themes to website visitors, compares conversion and target action and also applies statistical approach to compare these data.

Once visitor browses a website he or she is assigned to one Theme picked randomly and shown till the test ends. The data about actions he or she performs is submitted to Google Analytics counter installed on the website via custom parameter (Custom Dimension). A/B Theme Test add-on requests the API data from Google Analytics and counts the result according to the chosen Target when the report is requested (by clicking 'Current report' button).

Minimal requirements for A/B Theme Test add-on performance:

  • a WordPress website
  • a Google Analytics account
  • a Google Analytics code installed on a website (analytics.js or gtag.js)
  • configured Targets and/or E-Commerce reporting applicable to your testing Targets

A/B Theme Test add-on installation:

  • A/B Theme Test add-on requires your Google Analytics Client ID and Client Secret Key:
  • To get ID and Secret Key, you should be signed in Google Developers Console (you can find out how to make it in the Traffic Report guide starting from '3. How to make Google Analytics live stats show on your dashboard.')
  • Paste your Client ID and Client Secret Key in the A/B Theme Test add-on, get the Access Code and allow the add-on to view your Google Analytics data:
  • Copy the Access Code and choose your website in drop down list:

To start a Test, you should:

  • Set start and end Test dates if required (test will be performed automatically in this case). Though, we recommend to start and end your Test manually: Testing period depends on the range and it is not always clear, at what moment the range will be sufficient. To start Test manually just leave start and end dates blank and proceed to next step:
  • Choose another Theme you want to compare with the current Theme your website runs. If you want to compare two Themes none of which is active on your website at the moment, turn on the 'Enable comparison of two themes' feature and choose these two Themes:
  • Also, you can set a custom version of a Theme for the Test, by enabling devmode:

After enabling this toggle, you should go to Appearance and configure your custom copy of a Theme for the test. All the unauthorized users won't see the Switched Theme on the Frontend, so this custom Theme will be shown only within the Test.

  • Choose metric of the Test (by which action conversion change A/B Theme Test add-on will evaluate Theme performance. You can choose any Target from three ones you have set in your Google Analytics account, or to mark the transaction option (in this case conversion in purchase will be compared in both Themes):

  • Fill in Dimension filed: it should be a unique name in Latin letters with no spaces. This name will be visible in Google Analytics reports.
  • Create an additional parameter in your Google Analytics account, which will be related to your Tests storage.

Open admin panel of your Google Analytics account. Go to 'Property settings' - 'Custom definitions' - Custom dimension:

Click 'New custom dimension' button:

In the opened window fill in Parameter name which suits you best. In Scope settings choose 'User' and click 'Create':

In opened window click 'Done':

Check the index of your parameter:

Set it in A/B Theme Test add-on settings by putting it to 'Custom dimension index' field:

Click 'Save'.

Test is ready to start. If you have scheduled your Test it will start automatically, if you haven't you should click 'Start'.

Important! Settings of a Test can not be changed when it is active. In case you need to change its settings, you need to click 'Stop', make necessary amendments and click 'Start' again.

How to configure data collection if Google Analytics is installed via Google Tag Manager:

When Google Analytics is installed via Google Tag Manager it is not possible to send data from a 3-rd party application properly to it, and in this case the data collection is to be configured on the Google Tag Manager side.

Perform all the previous steps except the last one, you should set custom parameter index in the Google Tag Manager:

  • 'Create 1st party cookie' type variable, its name will correspond with the Test name set in settings
  • Remember the variable name
  • Edit the 'Google Analytics Settings' variable which is used once 'Page View' tag is fired. Set custom dimension with required index in this variable, and a value, which will look like this string: test name set in A/B Theme Test add-on, point, variable value (created in the previous step). This name is required for A/B Theme Test add-on being able to request Test data via API Google Analytics.

Example: test_theme1_theme2_20200426.{{abThemeTest}}

Did this answer your question?