Forum Moderators: open

Message Too Old, No Replies

Googlebot Not going beyond the homepage

Googlebot Not going beyond the homepage

         

hawk

8:14 am on Dec 31, 2002 (gmt 0)

10+ Year Member



Hi all,

I am a professional SEO consultant with a record of over 50+ optimized websites on Google with huge success.

Lately (Since November, 2002), I have noticed that the Googlebot has visited the homepage of my 4 new websites that were linked to very popular websites often visited by the Bot.

It has been over 2 months now and all this time, the bot seemed to have visited the same 4 homepages again and again. However, it fails to index the innerpages. Not even one inner page is indexed.

In one particular case, Google's cache shows the new updated homepage but has not crawled the new pages linked from the homepage. Rather, it continues to include the old web pages that are not even linked from anywhere. (Over 2 months now.)

Why is this happening....all these websites are extremely search engine friendly websites.

Also, the default I.P for these websites is always visited by Googlebot and all these sites exist in a seperate directory binded to the main I.P. Out of the 40 sites or so, almsot 30 are already included in the Google database. In one case, the site runs from an entirely differnet I.P, however with the same results.

At this point, I am clueless as to what could be the possible reasons for the googlebot not to crawl the inner pages of these websites.

Your valuable feedback would be much appreciated.

Thanks in advance.

hawk

1:27 pm on Dec 31, 2002 (gmt 0)

10+ Year Member



Hi, its ..me HAWK again.. in continuation to what I posted....I have some more info to share....

Our latest websites have been developed in the latest version of MX dream weaver, where by default, the tool does not include necessary HTML TAGS for links and text colours.

I.e the tags are completely missing.

Does HTML tags like Link Colours and Text colours have anything to do with search engine spidering (crawlers..do they care abotu such tags)

As per my researh, "YES" they do..to a large extent. Most of the index.html have been re-visited by googlebot and many other search engine crawlers, however, all of them failed to enter and index the inner pages. As a result, none of these websites, beyond their homepages, are indexed.

Your help would be greately appreciated.

Thanks again.

creative craig

1:32 pm on Dec 31, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



All a search engine spider is interested in is the <a href...> </a> part of the tag. It could underline green on a yellow background if you wanted it to, and then go to an overline afterwards!

Craig

mivox

6:10 pm on Dec 31, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Do you mean the <body> tag attributes for link and text colors? If so, the reason Dreamweaver MX would leave them out is probably because declaring text appreance attributes is moving into the realm of CSS, and Macromedia is doing their best to make their products compliant with the latest standards....

If you leave them out, a non-CSS savvy browser may render the page with default black text and blue links, but very few human visitors are using a browser that old anymore, and a spider doesn't really care what color the links are in the first place.