homepage Welcome to WebmasterWorld Guest from 54.226.168.96
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Website
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Where do spiders go?
i'm new to this
markbiz




msg:408184
 12:24 am on Jun 29, 2004 (gmt 0)

I got a visit from Googlebot on the main page of my site, and i had a question. When a spider visits your site, do they visit just your home page, or every single page on your site? Let's say i have 5 pages on my site, plus the home page. In order for the spider to visit all 5 of those pages, do they have to be linked to the home page? I had one page that i want the spiders to visit, but there's not a link to it from the home page, so will it still be crawled? Thanks for the help.

 

volatilegx




msg:408185
 5:08 pm on Jun 29, 2004 (gmt 0)

If you want them to visit that page (that isn't linked), then it would help if there was a link to that page someplace. Googlebot has to find out that page exists somehow, and links are the best way.

Another way would be if you have the Google toolbar installed, and the PageRank display turned on, and you visit that page, then Googlebot will know about it.

You could also directly submit the URL of that page to Google.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved