A General Class of No-Regret Learning Algorithms and Game-Theoretic Equilibria