Welcome to WebmasterWorld Guest from 174.129.151.95

Forum Moderators: open

Message Too Old, No Replies

JS Redirect and Web Spiders

How can I get a web spider to follow a link?

   
1:16 pm on Nov 16, 2001 (gmt 0)

10+ Year Member



Hi,

I'm having an issue with web spiders.

My default page is index.htm (as defined by my ISP) however I'm running a CF site.

So, in my index.htm page is a JS GoNow function to redirect to default.cfm

Only problem is WebSpiders won't/can't follow the JS link so my site doesn't get indexed.

I tried adding an href= statement after the GoNow, but it still looks like the spiders aren't following the link. (Once a spider does get to the default.cfm page, it will read the page properly, as tested by the SimSpider utility on this site)

Can anyone offer any suggestions?

Thank You
NS

1:24 pm on Nov 16, 2001 (gmt 0)

10+ Year Member



Add an ordinary text link to the page pointing at your new url. Not only will the spider be able to follow it, but so will any human visitors who have Javascript switched off.
1:44 pm on Nov 16, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Most spiders can also follow the META refresh method:

<meta http-equiv="refresh" content="0;URL=default.cfm">

Which goes in the <head> section of your HTMl. The 0 is the delay, in the example above, 0 seconds before redirect.

9:11 pm on Nov 16, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Change the default index file for your base directory to default.cfm. You can do this using your .htacess file (on apache)
9:58 pm on Nov 16, 2001 (gmt 0)

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member



> adding an href= statement after the GoNow

Maybe try it before the JS function. I'm having good luck with spiders following links that look like this:

<a href="address.html" onClick=function()>

<added> Whoops, I should have read closer. I see now their isn't any click!</added>

10:32 pm on Nov 19, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



"So, in my index.htm page is a JS GoNow function to redirect to default.cfm
Only problem is WebSpiders won't/can't follow the JS link so my site doesn't get indexed."

Why not submit the default.cfm page so spiders can start there?

10:42 pm on Nov 19, 2001 (gmt 0)

10+ Year Member



Thanks for all the advise:

-I have added both the text link and the Meta refresh
-I can't change the default index file as my site is hosted by my ISP (shared server)
-I am submitting /default.cfm, but that doesn't take care of the spiders that crawl through the net on their own (inktomi)

Thanks again
NS

10:48 pm on Nov 19, 2001 (gmt 0)

WebmasterWorld Senior Member nffc is a WebmasterWorld Top Contributor of All Time 10+ Year Member



>-I can't change the default index file as my site is hosted by my ISP (shared server)

Ask them to do it for you, if they won't move the site to an ISP who will.