A/B Testing
A/B Testing
There are many out there that say they do A/B testing but not all of them do it correctly and to the complexity needed for a conversion optimization project to be successful.
Our team is certified by the biggest A/B testing tools and we have one of the most thorough QA processes out there. You’ll be sure you’re getting top quality work and solid A/B tests.
What Is A/B Testing?
- A/B testing is more than changing page templates. It’s about understanding and changing user behaviour.
- An A/B test should always be based on a thoroughly researched testing hypothesis. Our hypotheses are based on relevant data that we gather from an in-depth analysis on your data and users behaviour.
A/B Testing: Our Process
Hypotheses Creation
The hypotheses are basically solutions to your website’s problems. We develop these ideas as a result of the initial site audit, competitor research and best practices.
Hypotheses Prioritization
The highest impact and lowest effort hypotheses will be tested first. How do we know which ones they are? They are each scored according to our own framework, which we developed in years of hands-on testing.
Design & Implementation
We design & implement all A/B tests in-house. Along with our designers and developers we are committed to ensuring a seamless implementation process. A thorough QA process follows, upon which we launch the A/B tests.
Progress Monitoring
We keep a close eye on each running experiment to see which version is performing better: the control or the variation. We update our testing file weekly with fresh data and constantly monitor our A/B tests.
Results Analysis
Once our A/B tests reach their sample size and confidence level, we conclude them and analyze the results. Winning tests will be implemented, while losing tests will help us gain further insights on user motivation.
Benefits of A/B Testing
Gooseberry
We absolutely love working with Andra and her incredible team. Their flexibility and willingness to adapt to our unique needs and challenges make them the ideal partner for us. Whether it’s a tight deadline or a last-minute change in direction, they consistently go above and beyond to deliver exceptional results.
Their work is not only beautifully crafted but also executed with impressive speed and attention to detail, allowing us to move forward with confidence knowing we’re in great hands. Andra and her team truly feel like an extension of our own, bringing a collaborative spirit and unwavering commitment to every project
Chine Leclere
HC
Marquese Dillon
AntoniaSaintNY
Working with OnTrack Digital has been a game-changer for our business! Their team truly understands the nuances of conversion rate optimization and took the time to analyze our goals and challenges. Thanks to their expertise, we’ve seen a significant boost in our website’s performance and customer engagement. If you want to maximize your online potential, OnTrack Digital is the way to go!
Argentina Flores
Wildbird
Working with OnTrack has been a fantastic experience! The team is incredibly hands-on, flexible, and genuinely attentive to our needs. They take the time to understand our goals and adapt their strategies as we go, making everything feel tailored just for us. Communication is smooth, and their responsiveness is on point—anytime we have questions or need adjustments, they’re right there to help. It’s clear that OnTrack is invested in our success. Highly recommend if you’re looking for a CRO agency that feels like an extension of your own team!
Nate Gunn
James Green – Nutriseed
Working with the Ontrack team on our CRO project has been an absolute pleasure! Their expertise, professionalism, and data-driven approach helped us unlock significant improvements in our conversion rates. They took the time to understand our goals and tailored strategies to fit our unique needs. Highly recommend Andra and her team for anyone looking to optimise their online performance!
James Green
Univera – Eric Davis
I’m most impressed with ONTRACK DIGITAL’s competency. They deliver exactly what they say they’re going to deliver. I know I can always rely on them, which is why I continue to hire them.
Eric Davis
ByBiehl – Alexandra Sifuentes
Our conversion rate has increased 30% overall in the year following our initial project and we’ve received nothing but postive feedback on the thumbnail header that was added to our mobile-design.
Alexandra Sifuentes
Nicolas Aagaard
We had a great collaboration and communication with Ontrack. Very quick follow up on their end! The team was very self sufficient and with a hands-on approach.
Nicolas Aagaard
Danny Bohnen
Ontrack Digital has done an amazing job on our CRO. They’ve ran multiple tests and improved our conversion rates. Communication is easy and their reporting is SUPER detailed! This service is a “MUST” if you’re looking to squeeze as much revenue out of your visitors as possible.
Danny Bohnen
Charlotte Driessen
We contracted Ontrack for a one-off audit on our web visitor journey. When the team went over the audit and identified areas of improvement, we immediately felt that we spoke the same language, and the Ontrack team had the deeper knowledge and experience that we missed. We’re now almost a year later and still hooked. Andra and her team have been consistently helping us identify, test and implement changes that have had a direct impact on our conversion rates.
Charlotte Driessen
Rebekah Daw
Andra and the team have been such a delight to work with. Not only have they been able to improve website performance for several of our clients , communication, execution and visibility on all projects has been extremely thorough. At every stage of the process, our team and clients have felt ultimately supported and provided with detailed reports, action items and updates. If you’re after a badass CRO team who ACTUALLY know what they are doing and do it well – hire these guys.
Rebekah Daw
Read one of our other case studies
Frequently Asked Questions
There is no universal traffic threshold. Feasibility depends on the baseline conversion rate, weekly conversions, traffic allocated to the experiment, and the minimum effect worth detecting. ONTRACK estimates the required sample before recommending a test; when it would take too long, the team can use customer research, usability testing, or a controlled rollout instead.
An A/B test should run until it has adequate sample size and covers the relevant business cycle, not until an early result looks positive. Traffic volume, conversion frequency, weekday patterns, promotions, and seasonality all affect duration. ONTRACK monitors experiments but avoids declaring a winner from short-term volatility.
ONTRACK prioritizes hypotheses using the strength of the evidence, expected business impact, reach, confidence, and implementation effort. Ideas originate from analytics, customer research, usability evidence, heuristic review, and observed funnel friction rather than from generic lists of ecommerce best practices.
A reliable result requires clean tracking, an appropriate sample, stable allocation, correct test implementation, and interpretation against a pre-defined primary metric. ONTRACK also checks supporting and guardrail metrics so that an apparent improvement in one step does not hide damage elsewhere in the journey.
A losing test is not automatically wasted work. ONTRACK documents the result, examines whether the hypothesis or execution failed, and uses the evidence to refine the next decision. The losing variation is not implemented merely to justify the effort already spent.
Treat another brand’s winner as a hypothesis, not as a guaranteed best practice. Differences in audience, price, product complexity, traffic source, brand positioning, and baseline UX can reverse the outcome. ONTRACK uses relevant case studies as evidence to investigate, then validates the idea in the new store’s context.