eprintid: 1388032
rev_number: 42
eprint_status: archive
userid: 608
dir: disk0/01/38/80/32
datestamp: 2013-04-05 10:45:34
lastmod: 2020-02-12 17:28:23
status_changed: 2013-04-05 10:45:34
type: proceedings_section
metadata_visibility: show
item_issues_count: 0
creators_name: Asthana, H
creators_name: Cox, IJ
title: Retrieval of highly dynamic information in an unstructured peer-to-peer network
ispublished: pub
divisions: UCL
divisions: A01
divisions: B04
divisions: C05
divisions: F48
abstract: We present a framework for the retrieval of highly dynamic information in an unstructured peer-to-peer network. Non- exhaustive search in an unstructured network is necessar- ily probabilistic, and we utilize the probably approximately correct (PAC) search architecture to determine the required replication rate for a document in order to guarantee a high probability of retrieval. Once this replication rate is deter- mined, the problem becomes how to replicate a new docu- ment across the network to meet this requirement, without overloading the communication capacity of the network. To solve this, we model the problem as rumour spreading, and use techniques from this field to propagate new documents. Our document spreading algorithm is designed such that a document has a very high probability of being replicated to the required number of nodes, but the probability of spread- ing to fewer or more nodes is small. Apart from facilitating rapid and restrained dissemination, our proposed method also withstands sudden spikes in the data creation rate. We illustrate the utility of the framework in the context of a micro-blogging social network. However it could also be used to index dynamic web pages in a distributed search engine or for a system which indexes newly created BitTorrents in a de-centralized environment. Simulations performed on net- work of 100,000 nodes validate our proposed framework.
date: 2013-09-09
vfaculties: VENG
oa_status: green
language: eng
primo: open
primo_central: open_green
verified: verified_manual
elements_source: Manually entered
elements_id: 855539
lyricists_name: Cox, Ingemar
lyricists_id: IJCOX77
full_text_status: public
event_title: 10th International Workshop on Large-Scale Distributed Systems for Information Retrieval
event_location: Rome, Italy
event_dates: 2013-02-05 - 2013-02-05
citation:        Asthana, H;    Cox, IJ;      (2013)    Retrieval of highly dynamic information in an unstructured peer-to-peer network.                     In:   (Proceedings) 10th International Workshop on Large-Scale Distributed Systems for Information Retrieval.          Green open access   
 
document_url: https://discovery.ucl.ac.uk/id/eprint/1388032/1/LSDSIR2013.pdf