A bottom-up approach to real-time search in large networks and clouds
2016 (English)In: Proceedings of the NOMS 2016 - 2016 IEEE/IFIP Network Operations and Management Symposium, IEEE conference proceedings, 2016, 985-990 p.Conference paper (Refereed)
Networked systems, such as telecom networks and cloud infrastructures, generate and hold vast amounts of configuration and operational data. The goal of this work is to make all this data available through a real-time search process named network search, which will enable new real-time management solutions. The thesis contains several contributions towards engineering a network search system. Key elements of our design are a weakly structured information model that includes spatial properties, a query language that supports location- and schema-oblivious search queries, a peer-to-peer architecture, an echo protocols for scalable query processing, and an indexing protocol for efficient routing for spatial queries. The data against which network search is performed is maintained in local real-time databases close to the data sources. The design follows a bottom-up approach in the sense that the topology for query routing is constructed from the underlying network topology. We have built a prototype of the system on a cloud testbed and developed applications that use network search functionality. Testbed measurements suggest that it is feasible to engineer a network search system that processes queries at low latency and low overhead and that can scale to 100'000 nodes. Simulation results for spatial queries show that query processing achieves response times and incurs overhead close to an optimal protocol, and that it remains accurate under significant churn.
Place, publisher, year, edition, pages
IEEE conference proceedings, 2016. 985-990 p.
bottom-up design, cloud management, distributed query processing, network management, network search, real-time management, Indexing (materials working), Network architecture, Query languages, Query processing, Safety devices, Software prototyping, Testbeds, Topology, Cloud managements, Information management
IdentifiersURN: urn:nbn:se:kth:diva-197200DOI: 10.1109/NOMS.2016.7502937ScopusID: 2-s2.0-84979787316ISBN: 9781509002238OAI: oai:DiVA.org:kth-197200DiVA: diva2:1055417
2016 IEEE/IFIP Network Operations and Management Symposium, NOMS 2016, 25 April 2016 through 29 April 2016
QC 201612122016-12-122016-11-302016-12-12Bibliographically approved