Forum Moderators: open

Message Too Old, No Replies

Deep crawl

Homepage hit and then that is it.

         

WallaceCleaver

4:02 pm on Aug 6, 2004 (gmt 0)

10+ Year Member



Googlebot has been making daily visits but it only comes to the homepage then takes off. What gives? I didn't have the following bit of html so I added it:

<META content=index,follow name=ROBOTS>

Do you think that this will make much of a difference?

Thanks!

DerekH

8:54 am on Aug 8, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



How deeply you get indexed depends on many things, not least of which is how many sites link to yours, so that Googlebot can find you easily. As you go further into your site, the pages there will, in general, have less links, and so probabalistically won't be stumbled upon as often.

As regards your meta tag, no you shouldn't need one. I only use a "noindex" tag on those few pages, such as booking forms, that I don't want cached because they have a drop-dead date after which I don't want them "looking interesting", while sitting, out of date, in Google's Cache.
If you DO use the Meta construct, be very sure to get it correct, syntactically, using the double quote ( " ) around the values that you cite.
DerekH

Marcia

9:12 am on Aug 8, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



<meta name="robots" content="index,follow">

That's the syntax and the default - no problem ever using it that way.