Nearly optimal exploration-exploitation decision thresholds