Forum Moderators: open

Message Too Old, No Replies

How does googlebot follow links?

         

boswell

12:51 pm on Nov 3, 2002 (gmt 0)



Hi all,
hope, I don't get flamed, should there be an obvious answer to my questions, but I can't see it.

I presume, googlebot follows links in the same order as they appear on the web page. Is this correct?

If so, does that mean googlebot will leave a site whenever it encounters an external link?

Analysing my log files, it looks that way.
I have banners on some pages, which appear as the first links and seem to prevent googlebot from reaching my menu structure and thus indexing my whole site.

Is there anything other, than removing the banners, that can be done?

Thanks in advance

rfgdxm1

1:05 pm on Nov 3, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Sounds to me you are seeing the Freshbot just normally grabbing only your index.htm page. The deep crawl is usually just once a month.

Nick_W

1:59 pm on Nov 3, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi, welcome to WebmasterWorld!

Agree with rfgdxm1. To pick up on another point though: We don't flame people here ;)

Nick