This paper introduces a peer-to-peer agent framework for supporting autonomic applications in decentralized distributed environments. The framework provides agents to discover, compose, and control elements. It defines agent interaction and negotiation protocols to enable appropriate application behaviors to be dynamically negotiated and enacted. The defined protocols and agent activities are supported by a scalable decentralized shared-space based substrate. The implementation and experimental evaluation of the system are also presented.