Optimization Testing 101: Part 3 – Choosing Between A/B or Multivariate Test Design
July 26th, 2010 admin
If you’ve been trekking along with us in our Site Testing 101 series, you’re already familiar with the difference between A/B and multivariate testing (opens in new window if you haven’t read the article and would like to get up to speed). Today’s installment looks at choosing the appropriate testing method for your experiment. A/B Split Testing Use A/B split testing when: You are just getting your feet wet with testing. A/B testing is simpler, so you can complete tests faster. Get a few “wins” under your belt before moving on to more complex experiments. You need to test only one variable. Your hypothesis may be “showing testimonials on the landing page…
Related Videos from Youtube
A Guided Tour of a Whiteboard Cultu...Elastic Path Software (www.elasticpath.com) - A task board is a familiar sign in companies practicing Agile. This presentation will show how visual communication of information can be used in a number of different ways by all departments to create an open, information rich environment. Such low cost, asynchronous distribution of information transforms organizational culture by promoting openness and building a shared vision. At Elastic Path, Informative Workspaces are used to communicate inside and outside of teams by product development, customer support, professional services, sales, human resources, marketing, operations, and executives.
A Guided Tour of a Whiteboard Cultu...Elastic Path Software (www.elasticpath.com) - A task board is a familiar sign in companies practicing Agile. This presentation will show how visual communication of information can be used in a number of different ways by all departments to create an open, information rich environment. Such low cost, asynchronous distribution of information transforms organizational culture by promoting openness and building a shared vision. At Elastic Path, Informative Workspaces are used to communicate inside and outside of teams by product development, customer support, professional services, sales, human resources, marketing, operations, and executives.
A Guided Tour of a Whiteboard Cultu...Elastic Path Software (www.elasticpath.com) - A task board is a familiar sign in companies practicing Agile. This presentation will show how visual communication of information can be used in a number of different ways by all departments to create an open, information rich environment. Such low cost, asynchronous distribution of information transforms organizational culture by promoting openness and building a shared vision. At Elastic Path, Informative Workspaces are used to communicate inside and outside of teams by product development, customer support, professional services, sales, human resources, marketing, operations, and executives.
A Guided Tour of a Whiteboard Cultu...Elastic Path Software (www.elasticpath.com) - A task board is a familiar sign in companies practicing Agile. This presentation will show how visual communication of information can be used in a number of different ways by all departments to create an open, information rich environment. Such low cost, asynchronous distribution of information transforms organizational culture by promoting openness and building a shared vision. At Elastic Path, Informative Workspaces are used to communicate inside and outside of teams by product development, customer support, professional services, sales, human resources, marketing, operations, and executives.
Related Posts
If you’ve been trekking along with us in our Site Testing 101 series, you’re already familiar with the difference between A/B and multivariate testing (opens in new window if you haven’t read the article and would like to get up to speed). Today’s installment looks at choosing the appropriate testing method for your experiment. A/B Split...
This is the first in a series of posts based on the material covered in our latest webinar: Taking Your Site Performance to The Next Level With Optimization Testing . Part 1 provides brief overview of what site testing is and describes the differences between usability testing, A/B split testing and multivariate methods. What is optimization testing?...
This is the first in a series of posts based on the material covered in our latest webinar: Taking Your Site Performance to The Next Level With Optimization Testing . The on-demand version will be available shortly. Part 1 provides brief overview of what site testing is and describes the differences between usability testing, A/B split testing...
Split testing – it’s not just for emails and landing pages anymore. This week, Google Adwords announced a new tool for its paid search advertisers: ACE (Adwords Campaign Experiments) (Beta) which allows you to split test your PPC campaigns. Until now, decisions to raise bids, add / delete keywords, change keyword match type or create...
This is the second in a series of posts based on the material covered in our latest webinar: Taking Your Site Performance to The Next Level With Optimization Testing . The on-demand version will be available shortly. According to Jupiter Research, 73% of marketers aren’t doing any testing whatsoever, with 49% having no plans to do so. Before...
This is the second in a series of posts based on the material covered in our latest webinar: Taking Your Site Performance to The Next Level With Optimization Testing . According to Jupiter Research, 73% of marketers aren’t doing any testing whatsoever, with 49% having no plans to do so. Before I share 4 compelling reasons why you should be testing,...
Though site testing can have many benefits, these common A/B and multivariate testing “gotchas” can lead you down the wrong path. Don’t make these mistakes! 1. Leaving Web Analytics Un-Optimized Before you get started testing, you want to make sure your web analytics are set up properly, not only so you can do proper analysis...
In our most recent webinar Taking Your Site Performance to The Next Level With Optimization Testing , an audience member asked a great question about site testing near a product launch. A perfect industry example is packaged software. A software product may release a new version every year or two. For the first few months after release, marketing...
In the spirit of the Winter Olympic games that ended last week, I would like to talk about the “winner” of the final A/B experiment we did for the Official Vancouver 2010 Olympic Store . We already achieved significant improvement with help of previous tests on the checkout process , product details page , and home page . So, shortly...
This is the fourth in a series of posts based on the material covered in our latest webinar: Taking Your Site Performance to The Next Level With Optimization Testing . The ultimate goal of a Web optimization project is to improve revenue and profits driven through your site. Success is measured by tracking changes in KPIs (key performance indicators),...
Related Tweets from Twitter
|
sanjay_pande (Sanjay Pande) : Customer retention and pricing? I disagree. Whats your opinion http://bit.ly/98YaWn.. Updated : 2010-09-05T21:29:03Z | Reply | View Tweet |
|
jaumegoma (Jaume Gom) : cada da me gusra ms getelastic.com http://bit.ly/bL0cWO hoy hablando de customer retention y destapando las pifias de mcafee.. Updated : 2010-09-05T18:23:24Z | Reply | View Tweet |
|
devseo (Alex Hall) : Losing Customers With Price Discrimination? - http://www.getelastic.com/customer-retention/.. Updated : 2010-09-05T13:26:10Z | Reply | View Tweet |
|
ltaloi (Liviu Taloi) : Citesc/Reading: Losing Customers With Price Discrimination?: If you offer products and services that generate recu... http://bit.ly/bZzjWw.. Updated : 2010-09-05T13:20:31Z | Reply | View Tweet |
|
BetterBizIdeas (Dan Ross) : 17 Ways To Minimize Friction in the #Sales Process http://bit.ly/aMHXNr #mmo #marketing.. Updated : 2010-09-04T22:05:29Z | Reply | View Tweet |
Related News from Digg
Leave a comment
| Trackback
