Trading Probability for Fairness