6 Reasons Why Your Site Isn’t Ready for A/B Testing

by | Sep 22, 2016 | Uncategorized

You’ve invested a lot of time and effort into refining your website and you want to get the maximum return from that investment. To achieve that goal, you’ve studied quite a few blogs on conversion optimization techniques. You’ve poured over countless CRO case studies, and you have a few tools to help you run A/B tests.

The issue is that your site just isn’t there yet. A/B testing isn’t for everyone, and if it’s not done at the right time with the right conditions, you might end up collecting a lot of false data that does more harm than good. Before you invest anything in testing and extensive optimization, consider these six points:

1. Low Site Traffic

There’s no doubt that A/B testing can be highly useful for businesses that want to improve their conversion rates. Having said that though, a lot of businesses shouldn’t bother with A/B testing.

Start ups, small businesses that are trying to grow, e-commerce businesses in their early years, and other micro businesses simply don’t have the traffic and transactions to precisely perform A/B tests. It takes a substantial amount of traffic to provide accurate, measurable results.

If the traffic isn’t there yet, you can still optimize your site based on demographic data you’ve gathered, but A/B tests won’t be helpful for a while and they might produce false information.

2. You’re Unsure What To Test

Do you know what the choke points, leaks, and sticking points are in your funnel? I’m referring to the places where you’re losing prospective customers, as well as where you’re gaining the most.

Before you can run any kind of tests, you have to understand what matters, because some elements are more important than others.

For example: a marketing agency is driving visitors to their estimate request page. They spend a significant amount of time optimizing that page with A/B testing variations and micro changes. After extensive testing, they find that their efforts made very little difference with nearly no impact on their conversions.

Instead, they should have looked for issues in their funnel leading up to that page. Maybe the content that led the visitor to that point was where the changes needed to be made. Maybe the search intent of the customer didn’t match the content they found.

If you randomly try to test what you think matters, then you’ll only be wasting time.

One study from Forrester showed that 60 percent of firms surveyed saw improvements in their website when they used a data-driven approach to design. It’s important to take the time to research what really matters to your business so you know what to optimize and where to make changes.

3. You’re Copying Content

While a competitor site (or any site for that matter) might look like an attractive design that your customers will probably engage with, you can’t waste time testing if you’ve played copycat.

Any tests you run after replicating their design and content will only be wasted. If the solution was as simple as copying what we thought worked well for our competitors (or even conversion case studies) then every e-commerce website would function exactly like Amazon.

The fact is, websites are highly contextual and they should relate to both the demographic and what you’re promoting. Wal-Mart and Whole Foods are in the same business of selling food products, but they cater to completely different demographics and sell vastly different products.

If I stacked up my own services against another marketing agency offering identical services, there would still be contextual differences in how we market, how we service customers, the channels we use to engage them, and how we direct traffic to our sites.

You need to make sure your website is designed specifically for you, your channels, your demographic, etc. before investing in testing.

4. There’s No Data

The more capable you are with analytics tools like Kissmetrics or Google Analytics, the better off you’ll be. But, if the extent of your knowledge consists of checking traffic quantities, referral sources, time on page and bounce rates, then you’re only scraping the surface.

You have to approach your testing and analytics with a problem so you can find an answer in the data. That way, you can identify issues and confirm what aspects you need to change.

Learning a bit more about your Google Analytics can tune you into:

  • How site elements or offers are performing
  • How your content is performing and whether it is keeping people engaged
  • What people are doing on your site and the routes they typically take
  • Where people are landing, as well as where they’re leaving
  • Where your funnel is losing money

The data won’t specifically tell you how to fix problems; it’s just a starting point where you can discover actionable insights. Without that data, and without the ability to interpret it, A/B testing is pointless.

5. Your Site Has Usability Issues

When was the last time you tested your website in a browser other than the one you typically use? Have you tried going through your entire site on a mobile device?

Have you ever performed a full usability test with a variety of browsers and devices?

This is something a lot of marketers don’t consider when they start A/B tests. Ignoring usability issues, tech problems, and bugs is a huge mistake, though. Even minor bugs and slow load times can dramatically impact your conversion rates.

Just a one second delay in load time can drop conversion rates by as much as 7 percent.

You won’t get accurate results from A/B testing if segments of your demographic are bailing due to usability issues. Some of your demographic may never make it to your conversion point, and even if they do, their progress could be hindered by bugs or load times that will ultimately skew your results.

This misinterpretation could lead to changes and further variations of elements that are actually part of your winning, optimized design.

6. You Don’t Know Your Demographics

Demographic research should be one of the first steps of any marketing strategy. If your goal is to drive lots of traffic to your site with content marketing and paid advertising, I would hope you’ve done some measure of demographic research.

Without it, you’re shooting blindly into the darkness and hoping to score a bullseye.

Researching and defining your target demographic gives you in-depth information about who you’re targeting, such as their pain points, interests, behaviors, demographics info, and more. That information helps you craft compelling copy, winning headlines, and attention-grabbing offers.

Without it, you’ll resort to guessing what to change about your copy, headlines, offers, and calls-to-action. Every variation you test will be just as random as the one before it, and you likely won’t see any significant change in performance.

Know who you’re marketing to before you make a large investment in A/B testing.

Written by Aaron Agius

Need Marketing Help?

Our job is to make your businness grow. Find out the difference JFG has made for our clients for 20+ years.

jfg logo

About J. Fitzgerald Group

JFG is an advertising and marketing agency located in Lockport, NY. JFG has helped businesses and organizations create and execute effective marketing strategies for 20+ years.