Googlebot index,follow?

Forum Moderators: open

Message Too Old, No Replies

Googlebot index,follow?

Does this code work?

Eljaybe

6:22 pm on Feb 27, 2004 (gmt 0)

I have watched a couple sites quickly move up in rank on Google for a very competitive keyword1 keyword2 phrase. Out of curiousity I checked the source code for these sites and they both show this code within the <head>...

My site does not have these codes. Does it make a difference? Will Googlebot and other spiders visit you more often if you include this code?

Dreamquick

8:29 pm on Feb 28, 2004 (gmt 0)

It shouldn't make a blind bit of difference...

The first two would be useful if those settings weren't already the defaults (unless you tell it otherwise googlebot indexes as much as possible and follows any links it finds). I'd say these were redundant but some people prefer to keep them because it makes them feel more comfortable.

The last tag is one of those things that everyone tries one (kinda like stuffing metatags full of keywords). It doesn't do anything special since if you could really define your own crawl schedule then you can bet good money a percentage of the people would abuse the system making it worthless.

- Tony

Eljaybe

2:53 pm on Mar 1, 2004 (gmt 0)

So should I assume that maybe these sites moved up in ranking because of link popularity? I have checked the backlinks to these sites and they don't have any more links than my site. Infact, one of the sites has most of its links from its own internal pages.

g1smd

3:42 pm on Mar 1, 2004 (gmt 0)

Those tags are not the reason. The third tag is a waste of bandwidth and should be deleted. The other two are actually just the default behaviour that a robot would do anyway, so those can also go.

There are many other reasons that it could be: <title>, meta description, on-page content, incoming links, and a whole host of other stuff.