Dependency isolation for thread-based multi-tier Internet services

— Multi-tier Internet service clusters often contain complex calling dependencies among service components spreading across cluster nodes. Without proper handling, partial failure or overload at one component can cause cascading performance degradation in the entire system. While dependency management may not present significant challenges for even-driven services (particularly in the context of staged event-driven architecture), there is a lack of system support for thread-based online services to achieve dependency isolation automatically. To this end, we propose dependency capsule, a new mechanism that supports automatic recognition of dependency states and per-dependency management for thread-based services. Our design employs a number of dependency capsules at each service node: one for each remote service component. Dependency capsules monitor and manage threads that block on supporting services and isolate their performance impact on the capsule host and the rest of the syste...

• Type: Conference
• Year: 2005
• Where: INFOCOM
• Authors: Lingkun Chu, Kai Shen, Hong Tang, Tao Yang, Jingyu Zhou
• Keywords: Communications, Dependency Capsules, Dependency Capsules Monitor, Dependency Isolation, INFOCOM 2005