Abstract— Robot ecologies provide a new paradigm for assistive, service, industrial, and entertainment robotics which is quickly gaining popularity. These ecologies contain a large number of robotic components pervasively embedded in the environment and interacting with each other. Human users of such systems need to be able to interface with both the system as a whole and, if desired, which each individual component. The humans should be able to transmit, in a natural way, commands that range from basic ones, such as “turn on the lights in the