Indexing Pages

Listing my site from index page

[nigel9097]

Hi,

Can any help me understand the spidering of a my site.

I was under the impression that if you submitted your index page, the rest of the pages in the site would be picked up by the spider and indexed along with the page that was submitted.

My index page has been visited and refreshed I know because I have changed the title several times, but text links to the other pages were not followed and the other pages were not indexed.

Do you have to submit each page individually or does it take a while for them to be picked up. Should they ALL be indexed by the spider on its first visit.

Each page has backlinks and they are all OK, so they all link up nicely, but no luck yet :(

Any help would be appreciated.

Kind Regards

Nigel

[OrlandoTodd]

Check to see if you have a robots tag excluding it, complicated scripts, long load times or anything that's different on the site.

If you have good back links to those pages, I don't see why they won't spider the whole site. You don't need to submit each page, but you do need to find out what's keeping the pages from not being picked up.

[graywolf]

Unless you have a lot of inbound links the first crawl won't be a deep one. If your inbound links are to pages other than your home page you can help your pages get indexed faster. Also if you use a site map you flatten out the hierarchy and help the spiders see all the links.