Offline Planning for Communication by Exploiting Structured Interactions in Decentralized MDPs