Date of this Version
We are developing a distributed query processor called PIER, which is designed to run on the scale of the entire Internet. PIER utilizes a Distributed Hash Table (DHT) as its communication substrate in order to achieve scalability, reliability, decentralized control, and load balancing. PIER enhances DHTs with declarative and algebraic query interfaces, and underneath those interfaces implements multihop, in-network versions of joins, aggregation, recursion, and query/result dissemination. PIER is currently being used for diverse applications, including network monitoring, keyword-based filesharing search, and network topology mapping. We will demonstrate PIER's functionality by showing system monitoring queries running on PlanetLab, a testbed of over 300 machines distributed across the globe.
Chun, Brent; Hellerstein, Joseph M.; Huebsch, Ryan; Jeffery, Shawn R.; Loo, Boon Thau; Mardanbeigi, Sam; Roscoe, Timothy; Rhea, Sean; Shenker, Scott; and Stoica, Ion, "Querying at Internet Scale" (2004). Departmental Papers (CIS). Paper 309.
Date Posted: 08 March 2007