翻訳と辞書 Words near each other ・ Google Wave Federation Protocol ・ Google Web Accelerator ・ Google Web Components ・ Google Web Designer ・ Google Web History ・ Google Web Toolkit ・ Google Website Optimizer ・ Google WiFi ・ Google X ・ Google+ ・ Google+(verb) ・ Google, Inc. v. American Blind & Wallpaper Factory, Inc. ・ Google.by ・ Google.org ・ Googlearchy ・ Googlebot ・ Googlefight ・ Googlepedia ・ Googleplex ・ Googleshare ・ Googlewhack ・ Googlism ・ Googlization ・ Googly ・ Googly (film) ・ Googly eyes ・ Googly Mohalla ・ GooglyMinotaur ・ Googol ・ Googolplex Dictionary Lists mini英和辞書 mini和英辞書 Webster 1913 Latin-English FOLDOC Wikipedia English ウィキペディア

翻訳と辞書　辞書検索 [ 開発暫定版 ] スポンサード リンク Googlebot ： ウィキペディア英語版 Googlebot Googlebot is the search bot software used by Google, which collects documents from the web to build a searchable index for the Google Search engine. If a webmaster wishes to restrict the information on their site available to a Googlebot, or another well-behaved spider, they can do so with the appropriate directives in a robots.txt file, or by adding the meta tag to the web page.〔 Googlebot requests to Web servers are identifiable by a user-agent string containing "Googlebot" and a host address containing "googlebot.com".〔Exact Googlebot client info can be found in Google-cached copies of pages which display such data to visitors. For example, see ()〕 Currently, Googlebot follows HREF links and SRC links.〔 There is increasing evidence Googlebot can execute JavaScript and parse content generated by Ajax calls as well. There are many theories regarding how advanced Googlebot's ability is to process JavaScript, with opinions ranging from minimal ability derived from custom interpreters. Googlebot discovers pages by harvesting all the links on every page it finds. It then follows these links to other web pages. New web pages must be linked to from other known pages on the web in order to be crawled and indexed or manually submitted by the webmaster. A problem which webmasters have often noted with the Googlebot is that it takes up an enormous amount of bandwidth. This can cause websites to exceed their bandwidth limit and be taken down temporarily. This is especially troublesome for mirror sites which host many gigabytes of data. Google provides "Webmaster Tools" that allow website owners to throttle the crawl rate. ==References== 抄文引用元・出典: フリー百科事典『 ウィキペディア（Wikipedia）』 ■ウィキペディアで「Googlebot」の詳細全文を読む スポンサード リンク 翻訳と辞書 : 翻訳のためのインターネットリソース Copyright(C) kotoba.ne.jp 1997-2016. All Rights Reserved.