Natural language communication is very important in Human-Robot cooperative work. This paper presents an object sorting robotic system which is controlled by natural language commands. A PA-10 robot manipulator is issued commands like "pick the big red cube" to pick objects placed on a table. The robot learns to interpret the meaning of this type of natural commands by learning individual lexical symbols in the grammar and their corresponding object features.