Forum Moderators: open

Message Too Old, No Replies

Spiders and other crawlers

how to get the bugs to find all my food?

         

leef50

10:04 pm on Apr 20, 2003 (gmt 0)

10+ Year Member



Well it's like this. The google spider seems only to index around 20 of my site pages at the moment out of 120 or so pages... the majority are in a support directoy which in turn has sub dirs with lots of pages. The problem is, it fails to get to these.

I toyed with a sitemap but I am a little confused... do I need to put a link on there to every page on my site? Since the links are there to the support areas already so what guarantee is there that they will be indexed via the sitemap.

As a test, I used the phpMySearch spider to do my site and again it still indexed the same pages even though I added a sitemap (locally) so how can I get spiders to eat all the food I have to offer?

Does it make a difference where the link to the sitemap page is on my page?

SEO practioner

10:32 pm on Apr 20, 2003 (gmt 0)

10+ Year Member



Hello Leaf50 and welcome to WW!

Always put the link to your sitemap directly on your homepage, where it will be used by your visitors, and by Google :-)

Additionally, make certain that your sitemap links to ALL the pages to your site. All the pages also means pages that are located in subdirectories and in sub-sub-directories...

That way, you will get the most impact and Google should be a happy camper, and, so will you!

:-) SEO