+- Support Forums (https://www.supportforums.net)
+-- Forum: Categories (https://www.supportforums.net/forumdisplay.php?fid=87)
+--- Forum: Computer Support Topics (https://www.supportforums.net/forumdisplay.php?fid=4)
+---- Forum: Networking, Wifi, and Internet Connection Help (https://www.supportforums.net/forumdisplay.php?fid=29)
+----- Forum: Web Browser Help (https://www.supportforums.net/forumdisplay.php?fid=45)
+------ Forum: Firefox Browser (https://www.supportforums.net/forumdisplay.php?fid=65)
+------ Thread: Imitate GoogleBot - Google's URI Crawler (/showthread.php?tid=8818)
Pages:
1
2
RE: Imitate GoogleBot - Google's URI Crawler - Dr Small - 02-04-2007
Hey! That ain't fair.
The point of imitating GoogleBot or some other bot, such as Archive.org is to make some webmaster think he's being spidered
It is fun, as I did it on MyBB Fans, and everyone though that Archive.org was hitting the forum !
Dr Small
RE: Imitate GoogleBot - Google's URI Crawler - mrksem454 - 04-26-2010
Well, Good One, Googlebot doesnââ¬â¢t traverse the web at all. It functions much like your web browser, by sending a request to a web server for a web page, downloading the entire page, then handing it off to Googleââ¬â¢s indexer.