Kinds of load balancing middleware have already been applied successfully in distributed computing. However, they don’t take the services types into consideration and for different services requested by clients the workload would be different out of sight. Furthermore, traditional load balancing middleware uses the fixed and static replica management and uses the load migration to relieve overload. However, to the complex service-oriented applications, the hosts may be heterogeneous and decentralized at all and load migration is not efficient for the existence of the delay. Therefore, we put forward an Agent based autonomic load balancing middleware to support fast response, hot-spot control and balanced resource allocation among different services. Corresponding simulation tests are implemented and their result s indicated that this model and its supplementary mechanisms are suitable to complex service-oriented applications.