<sub id="jznnx"></sub>

<address id="jznnx"></address>

    <sub id="jznnx"></sub>

        <address id="jznnx"></address>

          ************

          淺論外文翻譯___基于網絡爬蟲的有效URL緩存

          導讀:外文翻譯---基于網絡爬蟲的有效URL緩存
          中文2660字
          外文資料原文
          Efficient URL Caching for World Wide Web Crawling
          Marc Najork
          BMJ (International Edition) 2009
          Crawling the web is deceptively simple: the basic algorithm is (a)Fetch a page (b) Parse it to extract all linked URLs (c) For all the URLs not seen before, repeat (a)–(c). However, the size of the web (estimated at over 4 billion pages) and its rate of change (estimated at 7% per week) move this plan from a trivial programming exercise to a serious algorithmic and system design challenge. Indeed, these two factors alone imply that for a reasonably fresh and plete crawl of the web, step (a) must be executed about a thousand times per second, and thus the membership test (c) must be done well over ten thousand times per second against a set too large to store in main memory. This requires a distributed architecture, which further plicates the membership test.
          A crucial way to speed up the test is to cache, that is, to store in main memory a (dynamic) subset of the “seen” URLs. The main goal of this paper is to carefully investigate several URL caching techniques for web crawling. We consider both practical algorithms: random replacement, static cache, LRU, and CLOCK, and th
          上一篇論文:探討論文寫作 下一篇論文:淺議機電工程學院畢業設計規范(改)
          相關論文
          業務范圍
          免費本科范文
          免費碩士范文
          免費職稱范文
          論文****
          職稱論文****表
          五分pk10 www.igcp7.com | www.4102p.com | www.035059.com | 8522tttt.com | www.09888cp.com | www.620958.com | 866666m.com | www.jw799.com | www.703602.com | wnsr8813.com | www.58665s.com | www.366098.com | 56787qq.com | www.00778a.com | 54141144.com | 18438n.com | www.hg9209.com | 94948633.com | www.365815j.com | www.77114z.com | d2306.com | www.11777999.com | www.qmkl5.com | 99306o.com | www.4963ee.com | www.77114e.com | 2019o.cc | www.68365l.com | 2381f.com | www.666204.com | www.5091h.com | 04666r.com | www.38345z.com | www.51515t.com | www.86611a.com | www.77537.com | pw9.com | www.16602i.com | www.377291.com | 2019pp.cc | www.bet3651688.com | toucai11.com | www.hqg88.com | www.598074.com | 5168555.cc | www.456258.net | 3301800.com | www.sg8886.com | www.215880.com | 78117799.com | www.sx1800.com | 44qq8332.com | www.45966.net | www.394211.com | 6641u.com | www.9646z.com | ii4255.com | www.28000r.com | 4636644.com | www.05125a.com | www.975367.com | 2643w.com | www.kj333888.com | 07321111.com | www.614548.com | 5443yy.com | www.22js66.com | www.558423.com | www.a67783.com |