Forum Moderators: open

Message Too Old, No Replies

When in the month do the robots visit?

         

djtaverner

4:11 pm on Feb 10, 2004 (gmt 0)

10+ Year Member



If the new index for my site appears at the start of the month (1st or 2nd) how do I find out when google bot went into my site and registered changes?

cheers
Dave

plasma

7:19 pm on Feb 10, 2004 (gmt 0)

10+ Year Member



Many of us get deep crawled daily. And it takes approx. 1 day for the pages to appear in the SERPs.

AzCowboy

7:28 pm on Feb 10, 2004 (gmt 0)

10+ Year Member



You are exceeding blessed ...

My old PR8 site (now a PR6 post Austin) has not
been deep crawled in over a month ....

digitsix

7:32 pm on Feb 10, 2004 (gmt 0)

10+ Year Member



how do I find out when google bot went into my site

If you are asking how do you find out when google actually comes to your site, there is a nice stats program that works off of your weblog that you can use which will not only tell you when you were last spidered by virtually any search engine, it also tells you what keywords people are using to find your site and all of that jazz.

Its called AWstats and you can get it at:
[awstats.sourceforge.net...]

Chelsea

7:34 pm on Feb 10, 2004 (gmt 0)



Crawling frequency now seems to depend on links from authority sites. If you have a .edu, or large .org in the line somewhere this seems to help.