On the Design of an Efficient Architecture for Supporting Large Crowds of Autonomous Agents