Forum Moderators: open

Message Too Old, No Replies

ASP spider

         

defanjos

4:26 pm on Nov 1, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I need to write a ASP spider that can spider sites that I exchange links with, and check if my link is up. Can someone point me in the right direction?

The spider would have to get the their URL from a DB and check if my url is present. The spider needs to run from within the site, and not locally at my PC.

I looked around, but cannot find anything. All the programs available run locally, I need something to run from the server.

Thanks

raywood

4:29 pm on Nov 2, 2004 (gmt 0)

10+ Year Member



As far as I know an asp application can only run on a server that supports asp. So if you found a program that runs locally, it probably runs on IIS in your local windows machine.

Why wouldn't it run just as well on your host server? You may have to modify the code to tell it where to send the results. I've never seen one of these programs, but I can't see why it would make much difference where it was installed.

defanjos

5:48 pm on Nov 2, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks for your response.

Actually, I just got it to work using ASPtear.

Basically this is what I am doing:
- ASPtear gets the page specified in the db
- check for my site url using InStr
- update the DB with a yes or no
- write any errors to page - for example if the reciprocal url was not accessible.
- done

It seems to be working good :)

dataguy

12:29 pm on Nov 4, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I use ASPTear on my servers, and it works great....