homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

Strange Google crawl cycle

 8:57 am on Jan 17, 2003 (gmt 0)

Last 2 months Google has deepcrawled my sites in the 2 first weeks then not visit my sites in the end of the months. Is this normal?



 12:59 pm on Jan 17, 2003 (gmt 0)

The deep crawl normally takes place in the beginning of the month (these last months).

How was the crawling pattern before those last two months?


 6:51 pm on Jan 17, 2003 (gmt 0)

i still don't get it:

why is the deepcrawler still active on my sites?
(today and yesterday)


 7:16 pm on Jan 17, 2003 (gmt 0)

are you sure it's the deepcrawler and not the freshbot? what is its IP?


 7:34 pm on Jan 17, 2003 (gmt 0)

Yes, what IP. It would be highly unusual for deepcrawl to be active at this point of the month.


 7:38 pm on Jan 17, 2003 (gmt 0)

sorry, my mistake. I didn't see the "er", it was the fresbot.


 4:26 pm on Jan 18, 2003 (gmt 0)

<sigh> I guess that means I'll have to wait almost two months to see what the changes I've made this week will do.

I know...patience, patience. :)



 3:16 am on Jan 19, 2003 (gmt 0)

Anne, you are not alone. I am so impatient I should be placed in a coma until the next update begins.


 3:29 pm on Jan 19, 2003 (gmt 0)

I know what I should have done. I should have stuck with the changes I made at the first of this month to see how they affected my PR and search rankings. Then at the first of February I should have made the changes I just made. Meanwhile I should have carefully documented everything I did. But that would have taken patience. :o


 7:30 pm on Jan 19, 2003 (gmt 0)

I thought about that also, but I think with patience and FreshBot u could pull out some good fresh traffic with constantly changing pages.

troels nybo nielsen

 10:10 pm on Jan 19, 2003 (gmt 0)

Some of us actually are asking ourselves if freshbot now is being used in a slightly different way. Watch out and see if the dance will bring changes that seem to be based on freshbots work!


 11:48 pm on Jan 19, 2003 (gmt 0)


My site has a PR6 rating and in the last "dance" I moved up from #13 to #10 for my main keyword in 2.6 million results. Encouraged by this I have been reading the threads and trying to apply what is being recommended. I have now moved up to #9. While I am delighted, is this normal to move up or down between the refresh? Would the optimization of my pages have anything to do with this? Or, have the links I have been assiduously working on already bearing fruit?


 12:51 am on Jan 20, 2003 (gmt 0)

I'm seeing less freshbot activity compared to last month, an indexing interval that was unusually long. Maybe they've done a lot of algo testing and they're going to hit us soon with the next indexing... it's Jan 20.

I'm calling the yahoo backlinks change for Jan 28, 11:00 UTC

(figure I'll get my bid in early for the t-shirt)


 2:26 am on Jan 20, 2003 (gmt 0)

Some of us actually are asking ourselves if freshbot now is being used in a slightly different way.

I'm one of those wondering ... I've noticed over the last few weeks, some pages of my site that were indexed in the update have dropped out of the index and new ones have been added.. strange thing is the new pages don't include a 'freshbot' date often, suggesting that they are permanent.. These links are also very deep into my site, not just the main page!

I must say it's been great for testing changes -- usually only a few days later I can see a change in the results!

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved