Most people running analytics work at a large company and have a big stream of users to run experiments on. Our sample sizes are much smaller, which makes even conceptually simple approaches like A/B tests problematic. Just waiting long enough to get a statistically-significant results becomes a big bottleneck. ...

Tags: A/B Testing / Analytics / Share:

Via: PeteSearch Written by Pete Warden Brit in San Francisco, ex-Apple, Jetpac.com founder, ReadWri

Recently, there has been a lot of interest in a new, alternative approach to A/B testing. Thanks to a popular blog post with a catchy title: 20 lines of code that will beat A/B testing every time, this new, new thing was all over the Internet (Actually, it is not new. But public interest in it is new). This new approach is called multi-armed bandit algorithm, and since Visual Website Optimizer is ...

Tags: A/B Testing / Analytics / Share:

Via: Visual Website Optimizer Blog

I tweeted about low-volume A/B testing the other day, and wanted to share a few thoughts. I spent a few minutes talking to Hiten Shah (CEO of KISSMetrics) on the phone, who probably knows as much about A/B testing as anyone out there. He passed on three tips that I wanted to share here: ...

Tags: A/B Testing / Share:

Via: Giff Constable Written by Giff Constable MD at Neo in New York; maker, designer, entrepreneur, and ag

I read a great post today called "Throw Everything you Know About Ads Out the Window". The author describes how he ran a very simple test of two ads to see which would work better... The second ad generated a better CTR. Now what? Here is a list of reasons the second one might have gotten more clicks ...

Tags: A/B Testing / Conversion / Share:

Via: Rocket Watcher Written by April Dunford Co-founder of RocketScope http://rocketscope.com a marketing

Your first sales goal is to get as many of the the right set of customers signed up as possible. You can absolutely A/B test your way into a successful launch. A launch with a laser focus, the right price, and a line around the block of people shaking fistfuls of money to give you. Here is how ...

Tags: A/B Testing / Launch / Pricing / Share:

Via: Visual Website Optimizer Blog Written by Josh Ledgard

A/B testing is fundamentally a very simple concept. You have a webpage (landing page, homepage or product page) which you call version A. Now you make certain changes to it (changing headlines, buttons, colors, style or layout) and call the changed page as version B. Once you have version A and version B ready, any visitor that arrives on your webpage gets to either see version A or version B. ...

Tags: A/B Testing / Share:

Via: Visual Website Optimizer Blog Written by Paras Chopra Startups and Online Marketing enthusiast

Numerous times our clients and customers ask: how many visitors do I need to test in order to get statistically significant results in an A/B test? Unfortunately, there is no straightforward answer to this question as it depends on a number of factors. In the past, we have provided you with an A/B test duration [...] Related posts:A/B test duration calculator (Excel spreadsheet) What you really ...

Tags: A/B Testing / Share:

Via: Visual Website Optimizer Blog Written by Paras Chopra Startups and Online Marketing enthusiast