homepage Welcome to WebmasterWorld Guest from 54.161.185.244
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Code, Content, and Presentation / JavaScript and AJAX
Forum Library, Charter, Moderator: open

JavaScript and AJAX Forum

    
JS Redirect and Web Spiders
How can I get a web spider to follow a link?
nsantin

10+ Year Member



 
Msg#: 15 posted 1:16 pm on Nov 16, 2001 (gmt 0)

Hi,

I'm having an issue with web spiders.

My default page is index.htm (as defined by my ISP) however I'm running a CF site.

So, in my index.htm page is a JS GoNow function to redirect to default.cfm

Only problem is WebSpiders won't/can't follow the JS link so my site doesn't get indexed.

I tried adding an href= statement after the GoNow, but it still looks like the spiders aren't following the link. (Once a spider does get to the default.cfm page, it will read the page properly, as tested by the SimSpider utility on this site)

Can anyone offer any suggestions?

Thank You
NS

 

Will

10+ Year Member



 
Msg#: 15 posted 1:24 pm on Nov 16, 2001 (gmt 0)

Add an ordinary text link to the page pointing at your new url. Not only will the spider be able to follow it, but so will any human visitors who have Javascript switched off.

joshie76

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 15 posted 1:44 pm on Nov 16, 2001 (gmt 0)

Most spiders can also follow the META refresh method:

<meta http-equiv="refresh" content="0;URL=default.cfm">

Which goes in the <head> section of your HTMl. The 0 is the delay, in the example above, 0 seconds before redirect.

IanKelley

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 15 posted 9:11 pm on Nov 16, 2001 (gmt 0)

Change the default index file for your base directory to default.cfm. You can do this using your .htacess file (on apache)

tedster

WebmasterWorld Senior Member tedster us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 15 posted 9:58 pm on Nov 16, 2001 (gmt 0)

> adding an href= statement after the GoNow

Maybe try it before the JS function. I'm having good luck with spiders following links that look like this:

<a href="address.html" onClick=function()>

<added> Whoops, I should have read closer. I see now their isn't any click!</added>

Mark_A

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 15 posted 10:32 pm on Nov 19, 2001 (gmt 0)

"So, in my index.htm page is a JS GoNow function to redirect to default.cfm
Only problem is WebSpiders won't/can't follow the JS link so my site doesn't get indexed."

Why not submit the default.cfm page so spiders can start there?

nsantin

10+ Year Member



 
Msg#: 15 posted 10:42 pm on Nov 19, 2001 (gmt 0)

Thanks for all the advise:

-I have added both the text link and the Meta refresh
-I can't change the default index file as my site is hosted by my ISP (shared server)
-I am submitting /default.cfm, but that doesn't take care of the spiders that crawl through the net on their own (inktomi)

Thanks again
NS

NFFC

WebmasterWorld Senior Member nffc us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 15 posted 10:48 pm on Nov 19, 2001 (gmt 0)

>-I can't change the default index file as my site is hosted by my ISP (shared server)

Ask them to do it for you, if they won't move the site to an ISP who will.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Code, Content, and Presentation / JavaScript and AJAX
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved