Understanding the global semantics of referential actions using logic rules