Quick tips for things to consider when testing for balance:

  • Take notes throughout, but act upon the final result.
  • Good balance isn’t just fairness, but an approximately equal set of choices.
  • Always keep your design goals in mind.
  • Test with the same data before making changes.
  • Balance testing cannot truly begin until the mechanics are completed.

http://hyperbolegames.com/2012/09/14/balance-testing/