Scalable Matching and Ranking for Network Search
2013 (English)In: 2013 9th International Conference on Network and Service Management (CNSM), IEEE Computer Society, 2013, 251-259 p.Conference paper (Refereed)
Network search makes operational data available in real-time to management applications. In contrast to traditional monitoring, neither the data location nor the data format needs to be known to the invoking process, which simplifies application development, but requires an efficient search plane inside the managed system. The search plane is realized as a network of search nodes that process search queries in a distributed fashion. This paper introduces matching and ranking for network search queries. We are proposing a semantic for matching and ranking, which is configurable to support different types of management applications - from exact matching for database-style queries to loose, approximate matching, which is appropriate for exploratory purposes. We describe an echo protocol for efficient distributed query processing that supports matching and ranking. Further, we present the design of a search node, which maintains a real-time database of operational information and allows for parallel processing of search queries. A prototype implementation on a cloud testbed shows that the network search system, on a 9-node cluster with 24 core servers, executes 200 global search queries/sec with the 75th percetile latency below 100 milliseconds and with a CPU utilization below 5%. The performance measurements, together with our design, suggest that a system of 100,000 servers processing the same load would exhibit the same overhead per server and a query latency of below 1 sec.
Place, publisher, year, edition, pages
IEEE Computer Society, 2013. 251-259 p.
distributed management, distributed query processing, innetwork management, matching and ranking, Network search
IdentifiersURN: urn:nbn:se:kth:diva-128191DOI: 10.1109/CNSM.2013.6727844ISI: 000345853200042ScopusID: 2-s2.0-84894467062ISBN: 978-3-901882-53-1OAI: oai:DiVA.org:kth-128191DiVA: diva2:647231
2013 9th International Conference on Network and Service Management, CNSM 2013 and its three collocated Workshops - ICQT 2013, SVM 2013 and SETM 2013; Zurich; Switzerland; 14 October 2013 through 18 October 2013
QC 201309302013-09-102013-09-102016-04-11Bibliographically approved