Welcome to WebmasterWorld Guest from 184.108.40.206
Forum Moderators: open
Upon checking my logs, imagine how suprised I was to see about 1600 page fetches from:
Unless I've been working too many hours ( and I have ) and am seeing things ( which I don't think so ), it looks the deep crawler is diving in!
[ edit ] added the .46 to the IP's [ /edit ]
[edited by: SilentPartner at 3:49 am (utc) on June 13, 2003]
Then starting at 6:26:08 am the bot-like creature accessed page 1, then page 2 four times in a row over a span of about 30 seconds. (For a total of 4 page accesses each.)
I think that in my case the bot was attempting to figure out how similar the pages are and if they contain the same content. How have I reached this conclusion? The content of the pages in question are pricing comparisons for "Movie Title" and "Movie Title 2". (i.e. the original and the sequel).
I'm not sure if this helps anyone but I thought it might be significant.
joined:Oct 23, 2002
I've always felt that this was a better way for a search engine to do things, but maybe it was never considered possible with Google until on-the-fly PageRank calculations were perfected.
I also wonder how this bot now differentiates between content which is immediately published to the live index, and content that is stored for the next update?
Thanks a lot.
bizarre behavior really. we usually see deepbot hit most of our sites and client sites within the (relatively) same timeperiod. but i've only seen deepbot hit the one client site.
Makes you wonder if all the fresh data does make it into the index as fresh serps - or if it is a deepcrawl in disguise :)
Fredabot :) (Female Fresh/Deep bot - with the added advantage that we can call on Google to Fee the bot!)
I think the posting of the GoogleGuy Q&A was great and feel a new indexing will start soon, probably within a couple days. The reasoning behind this is that GoogleGuy seems to have tried to add some closure to the last update, thus making it possible to put to rest some fears about the ranking methods many felt were affecting them whether perminent or temporary.
With closure of the Dominic update, it now seems to me that a new update is soon to follow. It only makes sense to calm the masses before relighting the fire. I do believe the upcoming index will not be the spam ridden index a lot feel it has been experiencing lately, but, rather it will give much more insite to what the final Algo will be. Not the final Algo, but certainly closer the end result we may see in the near future.
I hope the worried have not changed their SEO thinking out of fear that they have been penalized or the practices they have been using have no weight anymore unless they know they do have something to worry about.(Not following true SEO practices)I don't think there should be such a great change as to affect sites that have been on top and deserve to stay with good relevant content, proper backlinks, and offering what the searcher is looking for.
When trying to make a better mouse trap you sometimes dismantle the one you know works, you then figure out through tried and true testing what can I do to make this mouse trap better. You then start to dismantle and manipulate inner parts piece by piece and test each one to see if the performance is better. Once the performance is better and meets your need you begin to rebuild. You rebuild by adding interior pieces first(you don't build from the outside in, you build from the interior working out)Now at this point, you have a solid base to work with and any enhancements can be made to the final product.
The only thing that seems to be stable since May 5th is the amount of Prozac some claim to be taking....LOL
All in all, I think we can come to a conclusion that Google was not broke, rather Google was undergoing an extreme makeover which in the long run will benifit searchers and honest SEO's and keep us on our toes as should be.
Wait it out and see the wonderful changes ahead. :)
But I have also got a few the 216.** Deep bots lately:
* User Session 220.127.116.11 - IPASS-1BLK (CA,US)
2003-06-03 18:25:20 - user created
2003-06-03 18:25:20 /zinline/inlinewifiareas1.htm
* User Session 18.104.22.168 - Google Inc. (CA,US)
2003-06-04 22:24:43 - user created
2003-06-04 22:24:43 /zinline/inlinehistory.htm
* User Session 22.214.171.124 - Google Inc. (CA,US)
2003-06-07 07:39:54 - user created
2003-06-07 07:39:54 /zthemes/party.htm
Just an FYI
As for new unknown IP's / robots, please use the Search Engine Spider Identification [webmasterworld.com] forum.
As for reports of freshbot and deepbot, please note that freshbot runs from 64.68.82.* and deepbot from 216.239.46.*.
Google has several other uses for 216.239.*.* i.e. Froogle, language tools etc.
The way I read Google Guy's postings (thanks GG!) is:
1. an update is comming soon, no time specifics.
2. freshbot is taking over the duties of deepbot.
Further there are indications that this is going to be the last update (dance session) and a more continous update will take over - a logic implication of freshbot taking over deepbot duties.