homepage Welcome to WebmasterWorld Guest from 54.161.175.231
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Spider Question
redliner




msg:399790
 7:13 pm on Mar 28, 2000 (gmt 0)

The SEs do not seem to be spidering my site. I am concerned that the use of JAVA script drop down menus might be the reason (this is what I am using for navigation). URL is: [goldenwebjewelers.com...] . Let me know if this is the problem. If it is does any one have a solution without adding more text/images to the index page, as it allready takes 26 seconds on download.

 

fantomaster




msg:399791
 8:58 pm on Mar 29, 2000 (gmt 0)

Suggest you add a site contents list consisting of invisible (preferably absolute) links on top of your
page, right beneath the BODY tag. JavaScript links will not be spidered by engines, so ...

redliner




msg:399792
 10:15 pm on Mar 29, 2000 (gmt 0)

I'm sorry confusion. Let me get this right under <body> use <!--http://www.goldenwebjewelers.com/examplelinlkpage.htm

Is this what you mean??

fantomaster




msg:399793
 10:28 pm on Mar 29, 2000 (gmt 0)

What I mean is that you reference the links as you would any other in normal HTML convention:
<A HREF:"http://yourdomain.com/page1.html"></A>
The difference being that you don't put anything before the end anchor tag </A> - this renders
the link invisible to a web browser, whereas the spiders will follow it.
Also, you might want to submit your pages individually to the search engines: not many will spider
or deep crawl an entire site following internal links anymore.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved