<sub id="jznnx"></sub>

<address id="jznnx"></address>

    <sub id="jznnx"></sub>

        <address id="jznnx"></address>

          ************

          淺論外文翻譯___基于網絡爬蟲的有效URL緩存

          導讀:外文翻譯---基于網絡爬蟲的有效URL緩存
          中文2660字
          外文資料原文
          Efficient URL Caching for World Wide Web Crawling
          Marc Najork
          BMJ (International Edition) 2009
          Crawling the web is deceptively simple: the basic algorithm is (a)Fetch a page (b) Parse it to extract all linked URLs (c) For all the URLs not seen before, repeat (a)–(c). However, the size of the web (estimated at over 4 billion pages) and its rate of change (estimated at 7% per week) move this plan from a trivial programming exercise to a serious algorithmic and system design challenge. Indeed, these two factors alone imply that for a reasonably fresh and plete crawl of the web, step (a) must be executed about a thousand times per second, and thus the membership test (c) must be done well over ten thousand times per second against a set too large to store in main memory. This requires a distributed architecture, which further plicates the membership test.
          A crucial way to speed up the test is to cache, that is, to store in main memory a (dynamic) subset of the “seen” URLs. The main goal of this paper is to carefully investigate several URL caching techniques for web crawling. We consider both practical algorithms: random replacement, static cache, LRU, and CLOCK, and th
          上一篇論文:探討論文寫作 下一篇論文:淺議機電工程學院畢業設計規范(改)
          相關論文
          業務范圍
          免費本科范文
          免費碩士范文
          免費職稱范文
          論文****
          職稱論文****表
          五分pk10 34757.com | 69445555.com | www.70msc.com | www.1754i.com | www.138037.com | 2824y.net | www.28000w.com | www.351867.com | 3568v.com | www.yinhennnn.com | www.bet686.com | www.142525.com | 1077uu.com | www.91779o.com | o8381.com | 76543y.com | www.932222.com | www.3416x.com | 5504j.com | www.mk856.com | www.71399c.com | 9438k.com | www.912suncity.com | www.77114w.com | 3522ii.com | www.403333.com | www.890886.com | 9068w.com | www.5966sss.com | www.3126p.com | qq8159.cc | www.335217.com | www.234297.com | 4508vv.com | www.85857n.com | www.755907.com | 44009193.com | www.998855u.com | www.422689.com | 3121z.com | www.2737012.com | www.307683.com | v2351.com | www.s32939.com | www.106395.com | bwinxxx.com | www.938w.cc | 32424g.com | 57157.com | www.55060a.com | wzyxwz.com | 777.bcbm777.com | www.vip81619.com | 55665156.com | www.747xpj.com | www.36166g.com | 3435n.com | www.4136t.com | www.303861.com | www.58339.com | www.81608g.com | 771381.com | www.22gp.com | www.ch8988.com | js345b.com | www.xj6002.com | 0o0qi1l.com | www.9679003.com | www.550437.com |