Comparing Operating Systems Using Robustness Benchmarks

When creating mission-critical distributed systems using off-the-shelf components, it is important to assess the dependability of not only the hardware, but the software as well. This paper proposes a way to test operating system dependability. The concept of response regions is presented as a way to visualize erroneous system behavior and gain insight into failure mechanisms. A 5-point “CRASH” scale is defined for grading the severity of robustness vulnerabilities encountered. Test results from five operating systems are analyzed for robustness vulnerabilities, and exhibit a range of dependability. Robustness benchmarking comparisons of this type may provide important information to both users and designers of off-the-shelf software for dependable systems.

• Type: Conference
• Year: 1997
• Where: SRDS
• Authors: Philip J. Koopman Jr., John Sung, Christopher P. Dingman, Daniel P. Siewiorek, Ted Marz
• Keywords: Mission-critical Distributed Systems, Operating System Dependability, Operating Systems, Robustness Vulnerabilities, SRDS 1997