Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL & keyplyr

Message Too Old, No Replies

Where do spiders go?

i'm new to this

12:24 am on Jun 29, 2004 (gmt 0)

New User

10+ Year Member

joined:Mar 21, 2003
votes: 0

I got a visit from Googlebot on the main page of my site, and i had a question. When a spider visits your site, do they visit just your home page, or every single page on your site? Let's say i have 5 pages on my site, plus the home page. In order for the spider to visit all 5 of those pages, do they have to be linked to the home page? I had one page that i want the spiders to visit, but there's not a link to it from the home page, so will it still be crawled? Thanks for the help.
5:08 pm on June 29, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 22, 2001
votes: 0

If you want them to visit that page (that isn't linked), then it would help if there was a link to that page someplace. Googlebot has to find out that page exists somehow, and links are the best way.

Another way would be if you have the Google toolbar installed, and the PageRank display turned on, and you visit that page, then Googlebot will know about it.

You could also directly submit the URL of that page to Google.