Cluster Computing on the Fly: P2P Scheduling of Idle Cycles in the Internet

— Peer-to-peer computing, the harnessing of idle compute cycles throughout the Internet, offers exciting new research challenges in the converging domains of networking and distributed computing. Our system, Cluster Computing on the Fly, seeks to harvest cycles from ordinary users in an open access, noninstitutional environment. The CCOF cycle sharing system encompasses all activities involved in the management of idle cycles: overlay construction for hosts donating cycles, resource discovery within the overlay, application-based scheduling, local scheduling on the host node, and meta-level scheduling among a community of application-level schedulers. We identify four important classes of cycle-sharing applications, each with distinct requirements that call for application-specific scheduling strategies. CCOF’s Wave Scheduler exploits large blocks of idle time at night, to provide higher quality of service for deadlinedriven workpile jobs, using a geographic-based overlay to organ...

• Type: Conference
• Year: 2004
• Where: IPTPS
• Authors: Virginia Mary Lo, Daniel Zappala, Dayi Zhou, Yuhong Liu, Shanyu Zhao
• Keywords: CCOF’s Wave Scheduler, CCOF’s Workpile Schedulers, Idle Compute Cycles, IPTPS 2004