homepage Welcome to WebmasterWorld Guest from 107.21.135.68
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Code, Content, and Presentation / JavaScript and AJAX
Forum Library, Charter, Moderator: open

JavaScript and AJAX Forum

    
JS Redirect and Web Spiders
How can I get a web spider to follow a link?
nsantin




msg:1482021
 1:16 pm on Nov 16, 2001 (gmt 0)

Hi,

I'm having an issue with web spiders.

My default page is index.htm (as defined by my ISP) however I'm running a CF site.

So, in my index.htm page is a JS GoNow function to redirect to default.cfm

Only problem is WebSpiders won't/can't follow the JS link so my site doesn't get indexed.

I tried adding an href= statement after the GoNow, but it still looks like the spiders aren't following the link. (Once a spider does get to the default.cfm page, it will read the page properly, as tested by the SimSpider utility on this site)

Can anyone offer any suggestions?

Thank You
NS

 

Will




msg:1482022
 1:24 pm on Nov 16, 2001 (gmt 0)

Add an ordinary text link to the page pointing at your new url. Not only will the spider be able to follow it, but so will any human visitors who have Javascript switched off.

joshie76




msg:1482023
 1:44 pm on Nov 16, 2001 (gmt 0)

Most spiders can also follow the META refresh method:

<meta http-equiv="refresh" content="0;URL=default.cfm">

Which goes in the <head> section of your HTMl. The 0 is the delay, in the example above, 0 seconds before redirect.

IanKelley




msg:1482024
 9:11 pm on Nov 16, 2001 (gmt 0)

Change the default index file for your base directory to default.cfm. You can do this using your .htacess file (on apache)

tedster




msg:1482025
 9:58 pm on Nov 16, 2001 (gmt 0)

> adding an href= statement after the GoNow

Maybe try it before the JS function. I'm having good luck with spiders following links that look like this:

<a href="address.html" onClick=function()>

<added> Whoops, I should have read closer. I see now their isn't any click!</added>

Mark_A




msg:1482026
 10:32 pm on Nov 19, 2001 (gmt 0)

"So, in my index.htm page is a JS GoNow function to redirect to default.cfm
Only problem is WebSpiders won't/can't follow the JS link so my site doesn't get indexed."

Why not submit the default.cfm page so spiders can start there?

nsantin




msg:1482027
 10:42 pm on Nov 19, 2001 (gmt 0)

Thanks for all the advise:

-I have added both the text link and the Meta refresh
-I can't change the default index file as my site is hosted by my ISP (shared server)
-I am submitting /default.cfm, but that doesn't take care of the spiders that crawl through the net on their own (inktomi)

Thanks again
NS

NFFC




msg:1482028
 10:48 pm on Nov 19, 2001 (gmt 0)

>-I can't change the default index file as my site is hosted by my ISP (shared server)

Ask them to do it for you, if they won't move the site to an ISP who will.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Code, Content, and Presentation / JavaScript and AJAX
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved