Manual Winner Picking for A/B Testing
I'd like to be able to review a/b tests for a partial send - ie 10% split. And then manually pick a winner.
I like to look at all the stats, not just one that is automated.
Mail chimp allows me to do this and i think it's a great feature! :)
For subject line A/B testing, offer this option for Winning Criteria:
if subject line open rate is a clear winner, send remaining contacts winning open rate subject line.
if subject line open rates are close - say within 1% - winner is the subject line that garners highest clicks.
My subject line tests often receive similar open results but sometimes the winner (only by a margin) doesn't end up with the higher clicks.
**Or, as another post suggested, just allow us to make a manual change to the criteria before the winner is sent.
Chris F. commented
Currently, when conducting an A/B test on a segment of a contact list, we must preset the victory conditions. We should be able to decide the victor manually (and then send a message to the remaining contacts), after seeing the results of the test.
It would be great to be able to change the winner criteria before the winner send. For example, my september a mailing had the highest open but only by a small percetage but c had more conversions. It would be great in this case to be able to change the criteria from opens to conversions.