Distributed Web Search Project

= Distributed Web Search =

This page is intended to keep a journal of progress for a course project in CPSC 601.38 "Networking Systems" (Fall 2013).

= Design =

Plug-in -> FIFO -> DHT client (keyword search terms)

Plug-in <- FIFO <- DHT client (URI replies back)

= Related Work / Links =

Papers

Fill in with links to papers...

http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=5307418 http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4537014 http://pdos.csail.mit.edu/papers/chord:sigcomm01/chord_sigcomm.pdf http://en.wikipedia.org/wiki/Chord_%28peer-to-peer%29 http://dl.acm.org/citation.cfm?id=383071 http://dl.acm.org/citation.cfm?id=1715744 http://www.researchgate.net/publication/224088158_Performance_improvement_of_Chord_Distributed_Hash_Table_under_high_churn_rate http://iptps05.cs.cornell.edu/PDFs/CameraReady_222.pdf http://pdos.csail.mit.edu/papers/chord:hotos01/hotos8.pdf
 * Chord

http://en.wikipedia.org/wiki/Pastry_%28DHT%29 http://research.microsoft.com/en-us/um/people/antr/PAST/pastry.pdf http://research.microsoft.com/en-us/um/people/antr/PAST/security.pdf http://www.l3s.de/~balke/lecture-p2p/Vorlesung_4.pdf http://www.ccsenet.org/journal/index.php/cis/article/view/4282/0 http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.59.9164&rep=rep1&type=pdf http://research.microsoft.com/en-us/um/people/antr/PAST/ring.pdf
 * Pastry

http://dl.acm.org/citation.cfm?id=383072 http://www-pr.informatik.uni-tuebingen.de/mitarbeiter/katharinazweig/downloads/p2p2005.pdf http://www.eecs.berkeley.edu/~sylvia/papers/cans.pdf http://www.research.rutgers.edu/~mcuenca/Publications/PlanetP-gossip-search-HPDC/index.html http://www.p2p.tu-darmstadt.de/fileadmin/user_upload/Group_P2P/share/p2p-ws10/Lecture_3-2.pdf http://www.bth.se/fou/forskinfo.nsf/all/83e2da713ffaedf9c12575d2002b5e1f/$file/paper_itcss-12.pdf http://www.eecs.berkeley.edu/~sylvia/papers/can-mcast.pdf http://hal.inria.fr/docs/00/87/09/67/PDF/RR-8375.pdf
 * CAN - Content Addressable Network

http://oceanstore.cs.berkeley.edu/publications/papers/pdf/tapestry_jsac.pdf http://www.cs.rit.edu/~ark/spring2010/730/team/4/presentation1.pdf http://bnrg.cs.berkeley.edu/~adj/publications/paper-files/tapestry_jsac.pdf
 * Tapestry

= Firefox Plug-in Links / Tutorials =


 * https://builder.addons.mozilla.org/tutorial/
 * https://addons.mozilla.org/en-US/developers/docs/sdk/latest/
 * https://addons.mozilla.org/en-US/developers/docs/sdk/latest/modules/sdk/io/file.html

This is an example similar to a system we want to build.
 * https://addons.mozilla.org/en-US/firefox/addon/wot-safe-browsing-tool/?src=cb-dl-mostpopular

= FIFOs / Named Pipes =

[michael@xorenduex tmp]$ mkfifo dws-keywords [michael@xorenduex tmp]$ mkfifo dws-uris [michael@xorenduex tmp]$ ls 02498526305cd		dws-uris|		launch-2e4G5L/		launch-RGXg6m/		launchd-343.NfFqv5/ com.rim.BBCM=		emacs502/		launch-3Edyws/		launch-YgleZb/ com.rim.BBDD=		icssuis502=		launch-EM08Ka/		launch-aiZRQe/ com.rim.BBDE=		launch-0Uvyt7/		launch-ONUFTv/		launch-pxC90h/ dws-keywords|		launch-1Wvi9u/		launch-OlVXry/		launch-xtYmmN/ [michael@xorenduex tmp]$

[michael@gondolin ~]$ cd /tmp/ [michael@gondolin tmp]$ ls 02498526305cd		icssuis502=		launch-OlVXry/ com.rim.BBCM=		launch-0Uvyt7/		launch-RGXg6m/ com.rim.BBDD=		launch-1Wvi9u/		launch-YgleZb/ com.rim.BBDE=		launch-2e4G5L/		launch-aiZRQe/ dws-keywords|		launch-3Edyws/		launch-pxC90h/ dws-uris|		launch-EM08Ka/		launch-xtYmmN/ emacs502/		launch-ONUFTv/		launchd-343.NfFqv5/ [michael@gondolin tmp]$ echo "michael" > dws-keywords [michael@gondolin tmp]$ echo "michael" > dws-keywords [michael@gondolin tmp]$ echo "hello" > dws-keywords [michael@gondolin tmp]$ echo "crocs" > dws-keywords [michael@gondolin tmp]$ echo "search keyword" > dws-keywords [michael@gondolin tmp]$ echo "http://crocodiles.com" > dws-uri [michael@gondolin tmp]$ echo "http://crocodiles.com" > dws-uris [michael@gondolin tmp]$

Last login: Fri Oct 11 19:06:45 on ttys010 [michael@gondolin ~]$ tail -f /tmp/dws-keywords michael michael hello crocs search keyword ^C [michael@gondolin ~]$ tail -f /tmp/dws-uris http://crocodiles.com

= DHT implementations =


 * http://sourceforge.net/projects/open-chord/