Oneapproachto measuringthe performanceof intelligent systemsis to developstandardizedor reproducibletests. Thesetests maybe in a simulatedenvironmentor in a physical test course.TheNationalInstitute of StandardsandTechnologyhas developeda test course for evaluating the performanceof mobileautonomousrobots operating in an urbansearchandrescuemission.Thetest courseis designed to simulatea collapsedbuildingstructureat variouslevelsof fidelity. Thecoursewill be usedin robotic competitions, suchas the AmericanAssociationfor Artificial Intelligence (AAAI)MobileRobotCompetitionand the RoboCupRescue. Designedto be highlyreconfigurableandto accommodatea variety of sensingandnavigationcapabilities, this coursemayserveas a prototypefor further developmentof performancetesting environments.Thedesign of the test coursebringsto light severalchallengesin evaluatingperformanceof intelligent systems,suchas the distinctionbetween "mind"and "body"and the accommodationof high-level in...