Why abTestBot?

The A/B testing engine built for accuracy, not just activity.

Core Differentiator

True Viewport Impression Tracking

Most A/B testing tools — Optimizely, VWO, AB Tasty — count an “impression” the moment a page loads, even if the visitor never scrolled down to see your change. This dilutes your data and slows down your ability to reach meaningful results.

abTestBot uses the browser’s IntersectionObserver API to only count an impression when your change actually enters the visitor’s viewport. This follows IAB/MRC viewable impression standards — the same standards used in digital advertising.

The result: no diluted results, faster statistical significance, and more accurate data.

Traditional Tools
Page Load = Impression

Counts visitors who never saw your change

abTestBot
Viewport Entry = Impression

Only counts visitors who actually saw it

Engagement Intelligence Per Variant

Other tools have heatmaps (Hotjar, Crazy Egg) or A/B testing (Optimizely, VWO) — but never both tied together. abTestBot tracks per-element engagement metrics directly tied to each variant:

Viewport Dwell Time

How long visitors linger on changed elements

Hover Tracking

Mouse attention signals on each element

Scroll Depth Correlation

How far visitors scroll in each variant

Element-Level Click Tracking

Per-element clicks tied to each variant

This tells you not just if a variant won, but why — did visitors spend more time reading the new headline? Did they hover over the CTA more? No other SMB A/B testing tool does this.

AI-Powered Test Ideas with Smart Goals

AI analyzes your live site and generates specific, actionable A/B test hypotheses. Each idea comes with pre-configured goals — the AI identifies what to measure (signup clicks, form submissions, page visits) with the exact CSS selectors and URL patterns.

One click on “Test This” takes you from idea to running experiment. Ideas are delivered on a schedule you choose — daily, weekly, or on demand.

Example AI-Generated Idea

“Replace the hero headline with a benefit-driven version emphasizing free trial. Hypothesis: visitors respond more to value propositions than feature descriptions.”

Goal: CTA click on .hero-signup-btn Goal: Page visit /signup

Bayesian Statistics in Plain English

No p-values, confidence intervals, or statistical jargon. abTestBot translates complex Bayesian statistics into language anyone can understand.

How results look in abTestBot:

“Variant B is converting 15.2% better. 89% chance it’s the real winner. Still early — need more visitors to be sure.”

Automatic winner detection with configurable confidence thresholds. Designed for marketers and product managers, not data scientists.

Lightweight & Fast

Under 1KB gzipped

Synchronous loading — zero content flicker

Async engagement tracking

Loads after page paint — zero performance impact

Cloudflare edge network

Sub-5ms latency globally

No CWV impact

No impact on Core Web Vitals scores

How abTestBot Compares

Feature abTestBot Optimizely VWO AB Tasty
Viewport-gated impressions
Per-variant engagement metrics
AI-generated test ideas Personalisation only
Smart goals from AI
Plain-English results Partial Partial Partial
<1KB snippet ~80KB ~50KB ~40KB
Free tier Limited
Bayesian statistics
Pricing Free + paid plans $50K+/yr From $393/mo Custom quote

Frequently Asked Questions

How is viewport tracking different from regular impression tracking?
Traditional A/B testing tools count an "impression" the moment a page loads — even if the visitor never scrolls down to see your change. abTestBot uses the browser's IntersectionObserver API to only count an impression when your modified element actually enters the visitor's visible viewport. This follows IAB/MRC viewable impression standards (the same standards used in digital advertising) and means your conversion rates reflect real human attention, not just page loads.
Will engagement tracking slow down my site?
No. The core tracking snippet is under 1KB gzipped and loads synchronously to prevent content flicker. Engagement tracking (hover, dwell time, scroll depth) loads asynchronously after the initial page paint, so it has zero impact on your Core Web Vitals or perceived load time. Everything is served from Cloudflare's edge network with sub-5ms latency globally.
How does the AI generate test ideas?
The AI analyzes your live website — its page structure, content hierarchy, calls to action, form layouts, and more — then generates specific, actionable A/B test hypotheses. Each idea includes pre-configured goals with the exact CSS selectors and URL patterns needed to measure success. You choose how often new ideas are generated, and you can launch any idea as a running experiment with one click.
What if my change is above the fold — does viewport tracking matter?
Yes, it still matters. Even above-the-fold elements aren't always visible — users may have different screen sizes, browser chrome heights, or may navigate away before the element renders. Viewport tracking ensures you're only counting visitors who actually had the opportunity to see and interact with your change, regardless of where it sits on the page.
How much traffic do I need for meaningful results?
Because abTestBot uses viewport-gated impressions (filtering out visitors who never saw your change), you typically reach statistical significance faster than with traditional tools. The exact traffic needed depends on your baseline conversion rate and the size of the effect you're testing for. Our Bayesian engine gives you a plain-English probability estimate that updates in real time, so you always know where you stand.
Can I use abTestBot with my existing analytics tools?
Absolutely. abTestBot uses a lightweight tracking snippet that runs alongside your existing analytics stack — Google Analytics, Mixpanel, Amplitude, Hotjar, or anything else. It doesn't interfere with other scripts and focuses specifically on A/B test execution and measurement.

Start testing smarter, not harder

Join teams who are getting more accurate results with less traffic.