This paper is concerned with how multi-agent reinforcement learning algorithms can practically be applied to real-life problems. Recently, a new coordinated multi-agent exploration mechanism, called Exploring Selfish Reinforcement Learning (ESRL) was proposed. With this mechanism, a group of independent agents can find optimal fair solutions in multi-agent problems, without the need for modeling other agents, without the need of knowing the type of the multiagent problem confronted with and by using only a limited form of communication. In particular, the mechanism allows for using natural reinforcement signals coming from the application itself. We report on how ESRL agents can solve the problem of load-balancing in a natural way, both as a common interest and as a conflicting interest problem. Categories and Subject Descriptors I.2.11 [Artificial Intelligence]: Distributed Artificial Intelligence—Intelligent Agents, Multiagent Systems General Terms Algorithms Keywords Reinfor...