Question

Topic: Other

A/b & Split Testing Of Website Content

Posted by Anonymous on 25 Points
Have been reading about a/b and split testing of webite content. What is involved in learning to do this professionally as part of website redesign work?
To continue reading this question and the solution, sign up ... it's free!

RESPONSES

  • Posted by Jay Hamilton-Roth on Member
    You need data (traffic), time to run the experiments, and a strategy to test efficiently.
  • Posted by steven.alker on Accepted
    If you’ve never done it before and unless you have a sound understanding of statistics in general and web marketing statistics in particular I would advise you to get some help – otherwise, again statistically, the chances of you making a hash of it and wasting your time whilst coming to the wrong conclusions are in the high 90% range.

    I’ve got that 90% + figure from our own clients who have tried to do something similar themselves. It usually costs them several times our initial quote to sort them out and that’s after they have wasted a couple of months on pointless testing or worse, implemented web policies based on statistical gibberish.

    If you’ve ever seen a company with a turnover of £5M get its forecasts wrong to the tune of £1M due to silly assumptions, then you’ll get the picture – it’s near fatal unless you have a very understanding bank manager.

    Steve Alker
    Xspirt
  • Posted by steven.alker on Member
    If you’ve never done it before and unless you have a sound understanding of statistics in general and web marketing statistics in particular I would advise you to get some help – otherwise, again statistically, the chances of you making a hash of it and wasting your time whilst coming to the wrong conclusions are in the high 90% range.

    I’ve got that 90% + figure from our own clients who have tried to do something similar themselves. It usually costs them several times our initial quote to sort them out and that’s after they have wasted a couple of months on pointless testing or worse, implemented web policies based on statistical gibberish.

    If you’ve ever seen a company with a turnover of £5M get its forecasts wrong to the tune of £1M due to silly assumptions, then you’ll get the picture – it’s near fatal unless you have a very understanding bank manager.

    Steve Alker
    Xspirt
  • Posted by steven.alker on Accepted
    Two thoughts here: Post a question with a largish number of points and see if you can attract the attention of some of our heavyweight stats people - making the question detailed and interesting also helps!

    Post a project on this site for, say, 2 or 3 hours on-line guidance and tuition from one of the experts – I believe that on-line projects posted here can be very cost efficient especially on the quality of delivery: Few want to be made out to be incompetent or offer poor value for money in front 340,000 of their peers!

    Steve

Post a Comment