Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
CTracker: a Distributed BitTorrent Tracker Based on Chimera
KTH, School of Information and Communication Technology (ICT), Communication: Services and Infrastucture, Telecommunication Systems Laboratory, TSLab.
KTH, School of Information and Communication Technology (ICT), Communication: Services and Infrastucture, Telecommunication Systems Laboratory, TSLab.
2008 (English)In: Collaboration and the Knowledge Economy: Issues, Applications, Case Studies / [ed] Paul Cunningham and Miriam Cunningham, Amsterdam: IOS Press , 2008, 941-947 p.Conference paper, Published paper (Refereed)
Abstract [en]

There are three major open issues in the BitTorrent peer discovery system, which are not solved by any of the currently deployed solutions. These issues seriously threaten BitTorrent's scalability, especially when considering that mainstream content distributors could start using BitTorrent for distributing content to millions of users simultaneously in the near future.

In this paper these issues are addressed by proposing a topology-aware distributed tracking system as a replacement for both centralized and Kademlia-based trackers.

An experiment measuring most popular open BitTorrent trackers is also presented. It shows that centralized trackers are not topology aware. We conclude that an ideal topology-aware tracker would return peers whose latency to the requester peer is significantly lower than of a centralized tracker.

Place, publisher, year, edition, pages
Amsterdam: IOS Press , 2008. 941-947 p.
Keyword [en]
dht, p2p, bittorrent
National Category
Communication Systems Computer Systems
Identifiers
URN: urn:nbn:se:kth:diva-46463ISBN: 978-1-58603-924-0 (print)OAI: oai:DiVA.org:kth-46463DiVA: diva2:453738
Conference
eChallenges 2008
Projects
P2P-Next
Funder
EU, FP7, Seventh Framework Programme, 21617
Note
QC 20111117Available from: 2011-11-17 Created: 2011-11-03 Last updated: 2013-12-03Bibliographically approved
In thesis
1. Kademlia on the Open Internet: How to Achieve Sub-Second Lookups in a Multimillion-Node DHT Overlay
Open this publication in new window or tab >>Kademlia on the Open Internet: How to Achieve Sub-Second Lookups in a Multimillion-Node DHT Overlay
2011 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Distributed hash tables (DHTs) have gained much attention from the research community in the last years. Formal analysis and evaluations on simulators and small-scale deployments have shown good scalability and performance.

In stark contrast, performance measurements in large-scale DHT overlays on the Internet have yielded disappointing results, with lookup latencies measured in seconds. Others have attempted to improve lookup performance with very limited success, their lowest median lookup latency at over one second and a long tail of high-latency lookups.

In this thesis, the goal is to to enable large-scale DHT-based latency-sensitive applications on the Internet. In particular, we improve lookup latency in Mainline DHT, the largest DHT overlay on the open Internet, to identify and address practical issues on an existing system. Our approach is implementing and measuring backward-compatible modifications to facilitate their incremental adoption into Mainline DHT (and possibly other Kademlia-based overlays). Thus, enabling our research to have impact on a real-world system.

Our results close the performance gap between small- and large-scale DHT overlays. With a median lookup latency below 200 ms and a 99\superscript{th} percentile of just above 500 ms, our median lookup latency is one order of magnitude lower than the best performing measurement reported in the literature. Moreover, our results do not show a long tail of high-latency lookups, unlike previous reports.

We have achieved these results by studying how connectivity artifacts on the underlying network ---probably caused by firewalls and NAT devices on the Internet--- affect the DHT overlay. Our measurements of the connectivity of more than 3 million nodes reveal that connectivity artifacts are widespread and can severely degrade lookup performance.

Scalability and locality-awareness have also been explored in this thesis, where different mechanisms have been proposed. Some of the mechanisms are planned to be integrated into Mainline DHT in future work.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2011. x, 31 p.
Series
Trita-ICT-ECS AVH, ISSN 1653-6363 ; 11:10
Keyword
dht, p2p, distributed systems, kademlia
National Category
Communication Systems
Identifiers
urn:nbn:se:kth:diva-46469 (URN)978-91-7501-153-0 (ISBN)
Presentation
2011-12-09, C2, Isafjordsgatan 22, Kista, 10:00 (English)
Opponent
Supervisors
Note
QC 20111118Available from: 2011-11-18 Created: 2011-11-03 Last updated: 2011-11-18Bibliographically approved
2. Distributed Peer Discovery in Large-Scale P2P Streaming Systems: Addressing Practical Problems of P2P Deployments on the Open Internet
Open this publication in new window or tab >>Distributed Peer Discovery in Large-Scale P2P Streaming Systems: Addressing Practical Problems of P2P Deployments on the Open Internet
2013 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Peer-to-peer (P2P) techniques allow users with limited resources to distribute content to a potentially large audience by turning passive clients into peers. Peers can self-organize to distribute content to each other, increasing the scalability of the system and decreasing the publisher’s costs, compared to a publisher distributing the data himself using a content delivery network (CDN) or his own servers.

Peer discovery is the mechanism that peers use to find each other. Peer discovery is a critical component of any P2P-based system, because P2P networks are dynamic by nature. That is, peers constantly join and leave the network and each individual peer is assumed to be unreliable. This thesis addresses practical issues in distributed peer discovery mech- anisms in the context of three different large-scale P2P streaming systems: a (1) BitTorrent-based streaming system, (2) Spotify, and (3) our own mobile P2P streaming system based on the upcoming Peer-to-peer Streaming Protocol (PPSP) Internet standard.

We dramatically improve peer discovery performance in BitTorrent’s Mainline DHT, the largest distributed hash table (DHT) overlay on the open Internet. Our implementation’s median lookup latency is an order of magnitude lower than the best performing measurement reported in the literature and does not exhibit a long tail of high-latency lookups, which is critical for P2P streaming applications.

We have achieved these results by studying how connectivity artifacts on the underlying network —probably caused by network address translation (NAT) gateways— affect the DHT overlay. Our measurements of more than three million nodes reveal that connectivity artifacts are widespread and can severely degrade DHT performance.

This thesis also addresses the practical issues of integrating mobile devices into P2P streaming systems. In particular, we enable P2P on Spotify’s Android app, study how distributed peer discovery affects energy consumption, and implement and evaluate backwards-compatible modifications which dramatically reduce energy consumption on 3G.

Then, we build the first complete system that not only is capable of streaming content to mobile devices but also allows them to publish content directly into the P2P system, even when they are behind a NAT gateway, with minimal impact on their battery and data usage.

While our preferred approach is implementing backwards-compatible modifications, we also propose and analyze backwards-incompatible ones. The former allow us to evaluate them in the existing large-scale systems and allow developers to deploy our modifications into the actual system. The latter free us to propose deeper changes. In particular, we propose (1) a DHT-based peer discovery mechanism that improves scalability and introduces localityawareness, and (2) modifications on Spotify’s gossip-like peer discovery to better accommodate mobile devices

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2013. x, 43 p.
Series
Trita-ICT-ECS AVH, ISSN 1653-6363 ; 13:19
National Category
Communication Systems
Identifiers
urn:nbn:se:kth:diva-134608 (URN)978-91-7501-917-8 (ISBN)
Public defence
2013-12-11, Aula, Forum, KTH-ICT, Isafjordsgatan 39, Kista, 13:00 (English)
Opponent
Supervisors
Note

QC 20131203

Available from: 2013-12-03 Created: 2013-11-25 Last updated: 2013-12-04Bibliographically approved

Open Access in DiVA

fulltext(392 kB)187 downloads
File information
File name FULLTEXT01.pdfFile size 392 kBChecksum SHA-512
795b4b219d6c724185f7dcc9856fa5cd27dc8d7bf2cad5b52237dd48a9b662c80bd82d42a9c02fe94eb404be518d93aa66d4cdb1e5856392fb8f2d6878ee91e0
Type fulltextMimetype application/pdf

Other links

eChallenges

Search in DiVA

By author/editor
Jimenez, RaúlKnutsson, Björn
By organisation
Telecommunication Systems Laboratory, TSLab
Communication SystemsComputer Systems

Search outside of DiVA

GoogleGoogle Scholar
Total: 187 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 107 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf