All Latest 537 A/B Tests

Only Significant A/B Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

MOST RECENT TESTS

Test #425 on by Jakub Linowski   Aug 03, 2022 Desktop Product

Jakub Linowski Tested Pattern #41: Sticky Call To Action In Test #425

In this experiment, the complete buy box on a product detail page, floated along as users scrolled through the long screen. The variation made sure the product choice and order now button was always visible. Impact on adds-to-cart and sales was measured.

Test #424 on by Sandis Viksna   Jul 28, 2022 Desktop Shopping Cart

Sandis Viksna Tested Pattern #45: Benefit Bar In Test #424

In this experiment, 3 reassurances were shown at the bottom of cart and checkout pages. The web site was selling health and nutrition products for males and one of the reassurances included "discreet shipping". Impact on sales was measured.

Test #423 on Expertinstitute.com by Ardit Veliu   Jul 26, 2022 Desktop Mobile Home & Landing

Ardit Veliu Tested Pattern #110: Optional Field Labels In Test #423 On Expertinstitute.com

In this experiment, an "optional" label was shown near a message form field. Impact on overall leads was measured (requesting experts).

Test #422 on Volders.de by Daria Kurchinskaia   Jul 22, 2022 Desktop Mobile Shopping Cart

Daria Kurchinskaia Tested Pattern #3: Fewer Form Fields In Test #422 On Volders.de

A birthdate field was removed during a signup process for a paid contract cancellation service. Impact on progression (next step) and sales (completed transactions) was measured.

Test #421 on Amazon.com by Marika Francisco   Jul 15, 2022 Desktop Mobile Product

Marika Francisco Tested Pattern #43: Long Titles In Test #421 On Amazon.com

Fluke is an industrial manufacterer of measurement and calibration devices and they ran a test on their Amazon store for a series of their prodcts. Instead of using short product names, they tested longer and more descriptive ones. Impact was measured on sales.

Test #420 on Designlab.com by Daniel Shapiro   Jul 12, 2022 Desktop Mobile Product

Daniel Shapiro Tested Pattern #115: Pricing Comparison Table In Test #420 On Designlab.com

In this experiment, pricing plans were laid out horizontally for easier comparison. In the variation, most of the plan benefits, features and differences were also referenced using a single lable that was left-aligned. The idea was to make the variables aligned and therefore more comparable.

This pricing table appeared at the bottom of a long design program landing page. Impact on leads and applications was measured.

Test #419 on by Jakub Linowski   Jun 29, 2022 Desktop Home & Landing

Jakub Linowski Tested Pattern #68: Welcome Discount In Test #419

In this experiment, the presence of a discount modal (bigger discount for larger purchases) was tested on home and product pages. The trigger happend after a scroll down, a few second pause, and a mouse scroll up interaction. Impact on sales was measured.

Test #418 on Online.metro-cc.ru by Andrey Andreev   Jun 28, 2022 Desktop Mobile Home & Landing

Andrey Andreev Tested Pattern #79: Single Or Multiple Triggers In Test #418 On Online.metro-cc.ru

In this experiment, popular product category links were added near the bottom of the homepage of an online grocery store - Metro. Impact on completed sales was measured.

Test #417 on Cxl.com by Ognjen Bošković   Jun 27, 2022 Desktop Mobile Signup

Ognjen Bošković Tested Pattern #127: Vague Or Specific Benefits In Test #417 On Cxl.com

CXL ran an interesting experiment that (1) added more specificity on a newsletter subscription page as well as (2) reinforced it consistently. Most visibly, an abstract or vague headline statement (control) was changed to a benefit oriented one - hinting that subscribers will eventually receive valuable case studies. This message was further reinforced with supporting copy that explained where these case studies are obtained from along with the frequency of the delivery. This same message was also reinforced with an image of actual case studies. The call to action button was also adjusted to mimic the benefit.

Impact on newsletter signups was measured.

Test #416 on Designlab.com by Daniel Shapiro   Jun 20, 2022 Desktop Mobile Product

Daniel Shapiro Tested Pattern #105: Lead Magnets In Test #416 On Designlab.com

In this experiment, copy was added which communicated that students signing up for a course would receive extra design resources (the lead magnet). This was added in multiple states of the course page. Impact on lead generation and enrollment was measured.

Test #415 on Learnwithhomer.com by Stanley Zuo   Jun 09, 2022 Mobile Checkout

Stanley Zuo Tested Pattern #3: Fewer Form Fields In Test #415 On Learnwithhomer.com

Do fewer confirmation form fields matter? In this experiment, redundant password and email confirmation fields were removed during a signup / checkout funnel. Impact on signups was measured.

Test #414 on Volders.de by Frederik Fröhle   May 31, 2022 Desktop Mobile Checkout

Frederik Fröhle Tested Pattern #98: Auto Suggest In Test #414 On Volders.de

Does adding Google's address auto complete functionality to an address field help with higher form completions? This auto fill feature has been tested in the variation of a contract cancellation funnel. After selecting an auto completed address from a pulldown menu, the following fields were preselected: house number, zip code, city and country (potentially lowering friction?). Impact on successful form completions (contract cancellations) has been measured. Notice how the form also expanded progressively upon selecting the complete address in the variation.  

Test #413 on by Jakub Linowski   May 26, 2022 Desktop Mobile Shopping Cart

Jakub Linowski Tested Pattern #114: Less Or More Visible Prices In Test #413

Should prices be displayed during an editing state on an add-to-cart screen (after adding-to-cart from a product detail page)? In this experiment, club pricing was added and shown in three areas after customers clicked on a small "edit details" links. The control did not have this pricing information (which was only shown on a product detail screen before).

Test #412 on Volders.de by Frederik Fröhle   May 16, 2022 Desktop Mobile Checkout

Frederik Fröhle Tested Pattern #15: Bulleted Reassurances In Test #412 On Volders.de

The Volders experimentation team assumed that adding information about how long it might take to get a cancellation confirmation near a CTA Button would result in higher cancellation requests (the paid service being offered).

The variation contained additional copy translated from German to: "Most of our users receive their cancellation confirmation from <vendor> within 14 days by email or letter."

Test #411 on by Ayat Shukairy   May 09, 2022 Desktop Mobile Product

Ayat Shukairy Tested Pattern #126: Bottom Or Left Thumbnails In Test #411

Bottom aligned thumbnails were shifted to the left side on a product image. Doing so, also shifted the product descriptions a little higher. Impact on adds-to-cart and total transactions was measured.

Test #410 on Designlab.com by Daniel Shapiro   May 05, 2022 Desktop Mobile Home & Landing

Daniel Shapiro Tested Pattern #29: Surfaced Content In Test #410 On Designlab.com

Does linking to a product detail page help? Or should a homepage simply focus on generic lead generation? In this homepage experiment, the presence of a component with a link to a detailed course landing page was tested. Impact on course enrollments was measured.

Test #409 on Expertinstitute.com by Ardit Veliu   Apr 30, 2022 Desktop Mobile Signup

Ardit Veliu Tested Pattern #20: Canned Response In Test #409 On Expertinstitute.com

In this experiment, the copy of an input textarea on a lead form was used to summarize a user's choices. Instead of showing using a generic "Message" statement, the variation use the following formula: "I'm a [Lead Type] located in [State] looking for [Expert Type]. Looking forward to hearing from you today. Thank You." Impact of leads was measured.

Test #408 on by Jakub Linowski   Apr 29, 2022 Desktop Mobile Product

Jakub Linowski Tested Pattern #67: Currency & Taxes In Test #408

Here is a very simple experiment where CDN currency copy was appended to prices being shown on a Canadian ecommerce site. Additional copy ("from Canada") was appended to an existing shipping message.  

Test #407 on Snocks.com by Melina Hess   Apr 22, 2022 Desktop Mobile Product

Melina Hess Tested Pattern #125: Unit Prices In Test #407 On Snocks.com

Here is an experiment with an added "price per pair" in the context of products with multiple items (packs).A high contrast badge-like copy was appended underneath the price which translates to "only $X per item". Impact on sales was measured.

Test #406 on Chaos.com by Velin Penev   Apr 12, 2022 Desktop Mobile Product

Velin Penev Tested Pattern #112: Lower Price Frames In Test #406 On Chaos.com

In this experiment, the pricing of three software plans was consistently framed into a more comparable monthly context. Whereas the control version only showed the total prices for each plan, the variation showed both the total and monthly prices. Impact on sales was measured.