All Latest 535 A/B Tests
Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first
MOST RECENT TESTS
Test #137 on Trydesignlab.com by Daniel Shapiro Dec 22, 2017 Desktop Mobile Checkout
Daniel Shapiro Tested Pattern #46: Pay Later In Test #137 On Trydesignlab.com
This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.
Test #138 on Trydesignlab.com by Daniel Shapiro Dec 22, 2017 Desktop Mobile Checkout
Daniel Shapiro Tested Pattern #42: Countdown Timer In Test #138 On Trydesignlab.com
This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.
Test #135 on Akademiafotografii.p... by Grzegorz Jancewicz Dec 18, 2017 Desktop Home & Landing
Grzegorz Jancewicz Tested Pattern #4: Testimonials In Test #135 On Akademiafotografii.p...
Test #136 on Missetam.nl by Marlies Wilms Floet Dec 18, 2017 Desktop Product
Marlies Wilms Floet Tested Pattern #42: Countdown Timer In Test #136 On Missetam.nl
De Nieuwe Zaak (a Dutch ecommerce agency) tested a countdown timer on an ecommerce site. The variation showed how many hours and minutes were left in order to be eligible for next day delivery. The variation beat the control which did not have this element of urgency.
Test #134 on Kenhub.com by Niels Hapke Dec 14, 2017 Desktop Product
Niels Hapke Tested Pattern #41: Sticky Call To Action In Test #134 On Kenhub.com
In this beautiful test, the key change was the introduction of a larger call to action linking to a premium / upgrade screen. The call to action was placed on the left sidebar which was floating. This is a great example of providing visibility to important elements by making them persistent.
Test #133 on Bing.com by Ronny Kohavi Dec 13, 2017 Desktop Mobile Listing
Ronny Kohavi Tested Pattern #43: Long Titles In Test #133 On Bing.com
In 2012 a Microsoft employee working on Bing had an idea about changing the way the search engine displayed ad headlines. Developing it wouldn’t require much effort—just a few days of an engineer’s time—but it was one of hundreds of ideas proposed, and the program managers deemed it a low priority. So it languished for more than six months, until an engineer, who saw that the cost of writing the code for it would be small, launched a simple online controlled experiment—an A/B test—to assess its impact. Within hours the new headline variation was producing abnormally high revenue, triggering a “too good to be true” alert.
HBR, September–October 2017 Issue, https://hbr.org/2017/09/the-surprising-power-of-online-experiments
Note: This experiment was a solid success and replicated multiple times over a period of months. It worked at Bing and had a profound influence. The only reason why we atributed a 0.25 point (a "Maybe") was because we don't have the exact sample size and conversion data.
Test #132 on Sjvc.edu by Phillip Barnes Dec 12, 2017 Mobile Home & Landing
Phillip Barnes Tested Pattern #41: Sticky Call To Action In Test #132 On Sjvc.edu
In this test, a footer with a button to a lead form was turned into a floating one.
Test #131 on Kenhub.com by Niels Hapke Dec 11, 2017 Desktop Home & Landing
Niels Hapke Tested Pattern #11: Gradual Reassurance In Test #131 On Kenhub.com
Test #130 on Kenhub.com by Niels Hapke Dec 07, 2017 Desktop Pricing
Niels Hapke Tested Pattern #17: Least Or Most Expensive First In Test #130 On Kenhub.com
In this experiment, the plans were sorted by the most expensive first, left to right (variation).
Test #128 on Acousticalsurfaces.c... by Nina Bayatti Dec 02, 2017 Desktop Signup
Nina Bayatti Tested Pattern #20: Canned Response In Test #128 On Acousticalsurfaces.c...
Test #127 on Glass.net by Mark Freedle Nov 23, 2017 Desktop Mobile Listing
Mark Freedle Tested Pattern #42: Countdown Timer In Test #127 On Glass.net
Test #126 on Rollbar.com by Mike Smith Nov 22, 2017 Desktop Signup
Mike Smith Tested Pattern #40: Blurred Product Background In Test #126 On Rollbar.com
Test #125 on Vivareal.com.br by Rodrigo Maués Nov 13, 2017 Desktop Product
Rodrigo Maués Tested Pattern #38: Faded Background Form In Test #125 On Vivareal.com.br
Test #119 on Vivareal.com.br by Rodrigo Maués Nov 01, 2017 Desktop Listing
Rodrigo Maués Tested Pattern #36: Fewer Or More Results In Test #119 On Vivareal.com.br
Test #120 on Vivareal.com.br by Rodrigo Maués Nov 01, 2017 Desktop Listing
Rodrigo Maués Tested Pattern #37: List Or Grid View In Test #120 On Vivareal.com.br
Test #117 on Ssdnodes.com by Matt Connor Oct 02, 2017 Desktop Shopping Cart
Matt Connor Tested Pattern #21: What It's Worth In Test #117 On Ssdnodes.com
Test #116 on Homewarrantyreviews.... by Sumantha Shankaranarayana Oct 01, 2017 Desktop Home & Landing
Sumantha Shankaranarayana Tested Pattern #33: Example Situations In Test #116 On Homewarrantyreviews....
Test #118 on Akademiafotografii.p... by Grzegorz Jancewicz Oct 01, 2017 Desktop Product
Grzegorz Jancewicz Tested Pattern #34: Open In A New Tab In Test #118 On Akademiafotografii.p...
The only change in this test was the way links were opened on this course listings page. Variation A opened links in the same window, and variation B opened them in a new tab (and focusing on the newly opened screen).
Test #114 on Akademiafotografii.p... by Grzegorz Jancewicz Sep 01, 2017 Desktop Listing
Grzegorz Jancewicz Tested Pattern #32: Condensed List In Test #114 On Akademiafotografii.p...
Test #113 on Vivareal.com.br by Rodrigo Maués Sep 01, 2017 Desktop Listing