homepage Welcome to WebmasterWorld Guest from 54.235.36.164
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld

Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Spider Question
redliner




msg:399790
 7:13 pm on Mar 28, 2000 (gmt 0)

The SEs do not seem to be spidering my site. I am concerned that the use of JAVA script drop down menus might be the reason (this is what I am using for navigation). URL is: [goldenwebjewelers.com...] . Let me know if this is the problem. If it is does any one have a solution without adding more text/images to the index page, as it allready takes 26 seconds on download.

 

fantomaster




msg:399791
 8:58 pm on Mar 29, 2000 (gmt 0)

Suggest you add a site contents list consisting of invisible (preferably absolute) links on top of your
page, right beneath the BODY tag. JavaScript links will not be spidered by engines, so ...

redliner




msg:399792
 10:15 pm on Mar 29, 2000 (gmt 0)

I'm sorry confusion. Let me get this right under <body> use <!--http://www.goldenwebjewelers.com/examplelinlkpage.htm

Is this what you mean??

fantomaster




msg:399793
 10:28 pm on Mar 29, 2000 (gmt 0)

What I mean is that you reference the links as you would any other in normal HTML convention:
<A HREF:"http://yourdomain.com/page1.html"></A>
The difference being that you don't put anything before the end anchor tag </A> - this renders
the link invisible to a web browser, whereas the spiders will follow it.
Also, you might want to submit your pages individually to the search engines: not many will spider
or deep crawl an entire site following internal links anymore.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved