Scaling a monitoring infrastructure for the Akamai network

We describe the design of, and experience with, Query, a monitoring system that supports the Akamai EdgePlatform. Query is a foundation of Akamai’s approach to administering its distributed computing platform, allowing administrators, operations staff, developers, customers, and automated systems near real-time access to data about activity in Akamai’s network. Users extract information regarding the current state of the network via a SQL-like interface. Versions of Query have been deployed since the inception of Akamai’s platform, and it has scaled to support a distributed platform of 60,000+ servers, collecting over 200 gigabytes of data and answering over 30,000 queries approximately every 2 minutes. Categories and Subject Descriptors C.2.4 [Distributed Systems]: Distributed applications, Distributed databases General Terms Design, Experimentation, Performance Keywords Distributed Systems, Scalability, Monitoring, Stream Processing, Distributed Databases

• Type: Journal
• Year: 2010
• Where: SIGOPS
• Authors: Thomas Repantis, Jeff Cohen, Scott Smith, Joel Wein
• Keywords: Distributed Computing Platform, Distributed Systems, Keywords Distributed Systems, SIGOPS 2010