%0 Conference Paper
%A Cho, J.
%A Garcia-Molina, H.
%A Page, L.
%B Seventh International World-Wide Web Conference (WWW 1998)
%C Brisbane, Australia
%D 1998
%F ilprints:347
%K crawling, crawler, URL ordering, archive
%T Efficient Crawling Through URL Ordering
%U http://ilpubs.stanford.edu:8090/347/
%X In this paper we study in what order a crawler should visit the URLs it has seen, in order to obtain more "important" pages first. Obtaining important pages rapidly can be very useful when a crawler cannot visit the entire Web in a reasonable amount of time. We define several importance metrics, ordering schemes, and performance evaluation measures for this problem. We also experimentally evaluate the ordering schemes on the Stanford University Web. Our results show that a crawler with a good ordering scheme can obtain important pages significantly faster than one without.
</div><div class="naked_ctrl">
<form action="/index.cgi/larger-text" method="get" name="gate">
<p><a href="http://altstyle.alfasado.net">AltStyle</a> によって変換されたページ <a href="http://ilpubs.stanford.edu:8090/cgi/export/347/EndNote/ilprints-eprint-347.enw">(-&gt;オリジナル)</a>
/ <label>アドレス: <input type="text" name="naked_post_url" value="http://ilpubs.stanford.edu:8090/cgi/export/347/EndNote/ilprints-eprint-347.enw" size="22" /></label> <label>モード: <select name="naked_post_mode">
<option value="default">デフォルト</option>
<option value="speech">音声ブラウザ</option>
<option value="ruby">ルビ付き</option>
<option value="contrast">配色反転</option>
<option value="larger-text" selected="selected">文字拡大</option>
<option value="mobile">モバイル</option>
</select>
<input type="submit" value="表示" />
</p>
</form>
</div>