Distributed Web Search Project

From wiki.ucalgary.ca
Jump to: navigation, search

Distributed Web Search

This page is intended to keep a journal of progress for a course project in CPSC 601.38 "Networking Systems" (Fall 2013).

Design

Plug-in -> FIFO -> DHT client (keyword search terms)

Plug-in <- FIFO <- DHT client (URI replies back)

Related Work / Links

Papers

Fill in with links to papers...

  • Chord
 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=5307418
 http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4537014
 http://pdos.csail.mit.edu/papers/chord:sigcomm01/chord_sigcomm.pdf
 http://en.wikipedia.org/wiki/Chord_%28peer-to-peer%29
 http://dl.acm.org/citation.cfm?id=383071
 http://dl.acm.org/citation.cfm?id=1715744
 http://www.researchgate.net/publication/224088158_Performance_improvement_of_Chord_Distributed_Hash_Table_under_high_churn_rate
 http://iptps05.cs.cornell.edu/PDFs/CameraReady_222.pdf
 http://pdos.csail.mit.edu/papers/chord:hotos01/hotos8.pdf
  • Pastry
 http://en.wikipedia.org/wiki/Pastry_%28DHT%29
 http://research.microsoft.com/en-us/um/people/antr/PAST/pastry.pdf
 http://research.microsoft.com/en-us/um/people/antr/PAST/security.pdf
 http://www.l3s.de/~balke/lecture-p2p/Vorlesung_4.pdf
 http://www.ccsenet.org/journal/index.php/cis/article/view/4282/0
 http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.59.9164&rep=rep1&type=pdf
 http://research.microsoft.com/en-us/um/people/antr/PAST/ring.pdf
  • CAN - Content Addressable Network
 http://dl.acm.org/citation.cfm?id=383072
 http://www-pr.informatik.uni-tuebingen.de/mitarbeiter/katharinazweig/downloads/p2p2005.pdf
 http://www.eecs.berkeley.edu/~sylvia/papers/cans.pdf
 http://www.research.rutgers.edu/~mcuenca/Publications/PlanetP-gossip-search-HPDC/index.html
 http://www.p2p.tu-darmstadt.de/fileadmin/user_upload/Group_P2P/share/p2p-ws10/Lecture_3-2.pdf
 http://www.bth.se/fou/forskinfo.nsf/all/83e2da713ffaedf9c12575d2002b5e1f/$file/paper_itcss-12.pdf
 http://www.eecs.berkeley.edu/~sylvia/papers/can-mcast.pdf
 http://hal.inria.fr/docs/00/87/09/67/PDF/RR-8375.pdf
  • Tapestry
 http://oceanstore.cs.berkeley.edu/publications/papers/pdf/tapestry_jsac.pdf
 http://www.cs.rit.edu/~ark/spring2010/730/team/4/presentation1.pdf
 http://bnrg.cs.berkeley.edu/~adj/publications/paper-files/tapestry_jsac.pdf

Firefox Plug-in Links / Tutorials

This is an example similar to a system we want to build.

FIFOs / Named Pipes

[michael@xorenduex tmp]$ mkfifo dws-keywords
[michael@xorenduex tmp]$ mkfifo dws-uris
[michael@xorenduex tmp]$ ls
02498526305cd		dws-uris|		launch-2e4G5L/		launch-RGXg6m/		launchd-343.NfFqv5/
com.rim.BBCM=		emacs502/		launch-3Edyws/		launch-YgleZb/
com.rim.BBDD=		icssuis502=		launch-EM08Ka/		launch-aiZRQe/
com.rim.BBDE=		launch-0Uvyt7/		launch-ONUFTv/		launch-pxC90h/
dws-keywords|		launch-1Wvi9u/		launch-OlVXry/		launch-xtYmmN/
[michael@xorenduex tmp]$ 
[michael@gondolin ~]$ cd /tmp/
[michael@gondolin tmp]$ ls
02498526305cd		icssuis502=		launch-OlVXry/
com.rim.BBCM=		launch-0Uvyt7/		launch-RGXg6m/
com.rim.BBDD=		launch-1Wvi9u/		launch-YgleZb/
com.rim.BBDE=		launch-2e4G5L/		launch-aiZRQe/
dws-keywords|		launch-3Edyws/		launch-pxC90h/
dws-uris|		launch-EM08Ka/		launch-xtYmmN/
emacs502/		launch-ONUFTv/		launchd-343.NfFqv5/
[michael@gondolin tmp]$ echo "michael" > dws-keywords 
[michael@gondolin tmp]$ echo "michael" > dws-keywords 
[michael@gondolin tmp]$ echo "hello" > dws-keywords 
[michael@gondolin tmp]$ echo "crocs" > dws-keywords 
[michael@gondolin tmp]$ echo "search keyword" > dws-keywords 
[michael@gondolin tmp]$ echo "http://crocodiles.com" > dws-uri
[michael@gondolin tmp]$ echo "http://crocodiles.com" > dws-uris
[michael@gondolin tmp]$ 


Last login: Fri Oct 11 19:06:45 on ttys010
[michael@gondolin ~]$ tail -f /tmp/dws-keywords 
michael
michael
hello
crocs
search keyword
^C
[michael@gondolin ~]$ tail -f /tmp/dws-uris 
http://crocodiles.com

DHT implementations