isp

google deepcrawl 4/27/2004
Menu

Fri Nov 21 2008

Web-Mastery Webmaster Forum

Fri Nov 21 2008

Home

google deepcrawl 4/27/2004


That would explain all the guests logged in and saying nothing.


does the deep crawl happen everywhere at once?


you should be seeing something.


PageRank is still blinking on and off. Strange update.


Edwin, you know Google has more than 1 datacenter, they are trying to hide their datacenters from public view but a website has some free tools to watch the datacenters in the link below, you may already know about this tool but if not check it out, he also has a keyword tool http://www.mcdar.net/ You guys know that Google has many Bots, if you look on the server logs you can see crawls from GoogleBot 13 14 and a bunch of others, Also Alexa, Slurp, Inktomi, and even some universities have crawlers. There was a new search engine called www.dipsie.com that was just hit the news that has a crawl also, www.teoma.com has their own crawl, that company is owned by www.ask.com So Google is not the only show in town, more search engines are listed at www.searchenginesinternational.com for you search freeks.


I guess more than one robot makes sense when you have the whole internet to spider ^-^ ... well, a lot of it.

Most Popular Stories
Broadband ISP