Bridging the past, present and future: Modeling scene activities from event relationships and global rules