JS Redirect and Web Spiders

Forum Moderators: open

Message Too Old, No Replies

JS Redirect and Web Spiders

How can I get a web spider to follow a link?

nsantin

1:16 pm on Nov 16, 2001 (gmt 0)

Hi,

I'm having an issue with web spiders.

My default page is index.htm (as defined by my ISP) however I'm running a CF site.

So, in my index.htm page is a JS GoNow function to redirect to default.cfm

Only problem is WebSpiders won't/can't follow the JS link so my site doesn't get indexed.

I tried adding an href= statement after the GoNow, but it still looks like the spiders aren't following the link. (Once a spider does get to the default.cfm page, it will read the page properly, as tested by the SimSpider utility on this site)

Can anyone offer any suggestions?

Thank You
NS

Will

1:24 pm on Nov 16, 2001 (gmt 0)

Add an ordinary text link to the page pointing at your new url. Not only will the spider be able to follow it, but so will any human visitors who have Javascript switched off.

joshie76

1:44 pm on Nov 16, 2001 (gmt 0)

Most spiders can also follow the META refresh method:

Which goes in the <head> section of your HTMl. The 0 is the delay, in the example above, 0 seconds before redirect.

IanKelley

9:11 pm on Nov 16, 2001 (gmt 0)

Change the default index file for your base directory to default.cfm. You can do this using your .htacess file (on apache)

tedster

9:58 pm on Nov 16, 2001 (gmt 0)

> adding an href= statement after the GoNow

Maybe try it before the JS function. I'm having good luck with spiders following links that look like this:

<added> Whoops, I should have read closer. I see now their isn't any click!</added>

Mark_A

10:32 pm on Nov 19, 2001 (gmt 0)

"So, in my index.htm page is a JS GoNow function to redirect to default.cfm
Only problem is WebSpiders won't/can't follow the JS link so my site doesn't get indexed."

Why not submit the default.cfm page so spiders can start there?

nsantin

10:42 pm on Nov 19, 2001 (gmt 0)

Thanks for all the advise:

-I have added both the text link and the Meta refresh
-I can't change the default index file as my site is hosted by my ISP (shared server)
-I am submitting /default.cfm, but that doesn't take care of the spiders that crawl through the net on their own (inktomi)

Thanks again
NS

NFFC

10:48 pm on Nov 19, 2001 (gmt 0)

>-I can't change the default index file as my site is hosted by my ISP (shared server)

Ask them to do it for you, if they won't move the site to an ISP who will.