- MarketingCareers
- Posts
- WTH is A/B Testing? | [Downloadable] Blueprint of A/B testing | CTA-GPT
WTH is A/B Testing? | [Downloadable] Blueprint of A/B testing | CTA-GPT


Table of Contents
Curated Careers
Trends and Tidbits:
WTH is A/B testing?
Other Types of Testing
A Blueprint of A/B Testing [Downloadable]
AI Arena:
Call-to-Action GPT
Interesting reads for the week
If this was forwarded to you, consider joining our community through this link.
š¼ Curated Careers š¼
Marketing Team Lead - Social Media at PTW International
š Full-time, Remote
āļø Brief: Lead and manage a team consisting of Product Marketing Managers, Social/Community Managers, Go-to-Market Coordinators, and Customer Support.
Apply
š Trendy Tidbits š
ā”ļø WTH is A/B Testing?
Imagine you are launching your new AI tool which generates pitch decks.
Work of hours done in minutes, just the way you want! (Coolš, right?)
Youāre excited, but youāre not sure how well it will sell.

So, you whip up two versions of your copy:
āMake your pitch deck in 2 minutes!"
āTRY our New AI tool with 100 free credits!ā
Which one do you think will bring in more sales?
~ Let me guessā¦.ammmā¦

Giphy
Well ā instead of guessing, why not test it?
Thatās where A/B testing comes in: a simple, yet powerful concept that can make a big difference in your marketing efforts. Soā¦
Letās dive into the world of A/B testing, shall we?
A/B testing (aka split testing) is like a showdown between two contenders.
You create two versions (A and B) of a digital asset with change in a single variable. Whether itās a headline, image, call to action, or the background colour - and pit them against each other to see which one performs better.
Think of it as a scientific experiment. āThe subjectsā are two similar sets of elements, and the metrics used to conclude are ā bounce rate, open rate, clicks, conversion rates, etc.
Imagine youāre optimizing a landing page. You might have a hypothesis like:
āI think a red call-to-action button will perform better than a blue one.ā
To test this, you show version A (the blue button) to half of your visitors and version B (the red button) to the other half.
Then, you simply measure which version gets more clicks.
Easy, right?
But hereās the kicker: A/B testing isnāt just about picking the winner. Itās about understanding why one version outperformed the other so you can apply those insights across all your marketing efforts.
And if you already think that one test is enough for your whole campaign, then you might be wrong.
If you really want to reach the peak of conversion rates, you must keep testing every now and then.
And thatās why it is called A/B testingā Always Be Testing
Or maybe that is how I remember it š
ā”ļøWhy A/B testing matters?
You might be wondering,
āWhy go through all this trouble? Canāt I just trust my gut?ā
Sure, your instincts might be sharp, but A/B testing gives you a data-backed proof. When it comes to conversion rates, the smallest tweaks, like changing a single word in a headline ā can make all the difference.
Hereās the deal: most marketers think they know what their audience wants.
ā But the truth is, even seasoned pros get it wrong. A/B testing helps you avoid costly mistakes and ensures that the decisions are based on hard data, not hunches.
And that was my pitch on why you should certainly do testing. Now, letās get to know other types.
ā”ļøOther types of tests
If youāve ever wondered, āWTH is multivariate testing?ā
āAre split testing and split URL testing the same?ā
Then let me tell you the other types of tests ā
1) Split URL Tests
Donāt be the one to confuse it with A/B testing.
In the case of Split URL testing, the visitor is redirected to an entirely new webpage-URL, rather than just some elemental changes in the existing page.
When you run a Split URL test, your website traffic is split between the control (original web page URL) and treatment (new web page URL). For exampleā
This is useful when youāre up for more than just switching UI/UX and copy. You might test a totally different database or data collection tool.
Meanwhile, your original webpage is also active and receives half the traffic.
ā Compare the results from the old and the newā drive the winner.
2) Multivariate Tests (MVT)
Here, you test changes in multiple variables at once.
ā Then check which combination of variables works best.
Sounds complicated? Yes, it is! š
Letās simplifyā
Letās say you decide to test 2 variations of each hero image (1/2) , CTA-button-color (blue/red), and headlines (1/2) of your landing page.
So, the combinations for the test can beā
Hero-image(1) & CTA-button(blue) & Headline(1)
Hero-image(1) & CTA-button(blue) & Headline(2)
Hero-image(1) & CTA-button(red) & Headline(1)
Hero-image(1) & CTA-button(red) & Headline(2)
Hero-image(2) & CTA-button(blue) & Headline(1)
Hero-image(2) & CTA-button(blue) & Headline(2)
Hero-image(2) & CTA-button(red) & Headline(1)
Hero-image(2) & CTA-button(red) & Headline(2)
A total of 8 different combinations.
Here, the number of total combinations/versions obtained are given byā
[No. of variations of element A] x [No. of variations of element B] x [No. of variations of element C]⦠= [Total No. of variations]
For the above exampleā
Total No. of Versions = 2 X 2 X 2 = 8
Which simply means you need to divide your traffic for all 8 versions.
āIf you are just starting or if your user-base is not so big. Then this might not be the option to go for. The obvious reason is a narrow sample set for such a combinatory test.
It is mostly used for advanced product marketing for a larger user base.
~Why do they complicate it Deep? Any advantages for them?
Yep, it helps avoid multiple A/B tests with the same goal
saves time since you can track multiple elements of the testpage.
Understand the interaction of page elements with each other.
3) Multipage Tests
Here you pick particular elements and vary them through multiple pages in your sales funnel to see if there is any impact.
ā”ļøComponents of an A/B Testā”
A complete A/B test has the following componentsā
1) Goal: What is that one metric you want to improve? For example, a boost in page views or a reduced bounce rate.
2) Hypothesis: What are the one or two changes that you think can bring you better results? Recall the example I gave you in the beginning.
3) Variables: Determine what to testāyour page titles, lead images, email subject lines, CTA buttons, or other elements.
4) Duration: How long will you run the test? (Run it long enough to draw meaningful data)
5) Control group: Select a random sample of 50% of visitors who will only see the original version (A).
6) Treatment group: Choose other 50% with similar characteristics to those of the control group. These users will see the modified version (B).
Now that youāre sold on the idea, letās break down how you actually do A/B testing.
Check out this framework that we have designed based on the best A/B testing guides researched from over 15+ resources over the internet.
ā”ļøThe A/B Testing Blueprint used by CRO Championsā”

|
Well, that marks a wrap on A/B testing.
Cheers on completing step 4 of becoming a championš in Conversion Rate Optimization(CRO). Now, youāre left with just one last stepā Retargeting!
Weāll share that in the next issue on Tuesday!
If you didnāt check out the last issue, where I explained whatās wrong with your landing page? click here.
š¤ AI Arena š¤
ā”ļøCTA Generator GPT
This prompt helps you generate a highly convertible Call-to-Action copy.
First, Copy the following prompt and fill all the empty square spaces with information related to your e-commerce business. Now, wait for chatGPT to do its work. It generates 4 CTAs at a time. (Helps you brainstorm your CTAs.)
Here is one example we tested for an organic cosmetic brand website.
But, many marketers donāt know this about CTAs.
Prompt:
Act like a seasoned copywriting expert who has been specializing in creating high-conversion Call to Action (CTA) copy for e-commerce businesses for over 15 years. Your objective is to generate four highly effective CTA suggestions that align perfectly with the user's business goals, audience, and brand voice.
Step 1: Gather Business Information
Industry: [Insert industry, e.g., fashion, electronics, health, etc.]
Target Audience: [Describe the target audience, including demographics and interests]
Unique Selling Proposition (USP): [What sets the product/service apart?]
Current Marketing Goals: [e.g., increasing sales, growing email list, boosting engagement]
Step 2: Understand the E-commerce Platform
E-commerce Platform: [e.g., Shopify, WooCommerce, Magento]
Website URL: [Provide the website URL]
Key Products/Services: [List the primary products or services offered]
Current CTA Phrases: [Share any existing CTA phrases or concepts currently in use]
Step 3: Review the Website Copy
Homepage Copy: [Copy or describe the tone and style of the homepage text]
Product Page Copy: [Copy or describe the tone and style of the product pages]
Brand Voice and Style: [Describe the brandās tone, voice, and style]
Step 4: Generate CTA Suggestions
Based on the provided information and the current trends and CTAs that work in my domain of business, generate four tailored CTA suggestions that are likely to resonate with the target audience and drive conversions..
Please provide your suggestions in a clear and structured format. Feel free to use bullet points, tables, or any format that makes your recommendations easy to follow.
Take a deep breath and work on this problem step-by-step.
š§ Interesting readsš§
š Ask for something in return for your free offer ā Link
š These 'living computers' are made from human neurons ā Link
š Disruptive AI Video Trends that are Transforming Marketing in 2024ā Link
šHow AI is revolutionizing how firefighters tackle blazes ā Link
š 8 best AI PDF tools in 2024, compared ā Link

Thanks,
Deep Kakkad, your marketer friend.
Reply