Forum Moderators: martinibuster

Message Too Old, No Replies

Automated link veryfication and contact

         

cyberair

4:03 pm on Nov 17, 2003 (gmt 0)

10+ Year Member



I have a website that has over 4600 approved links in the directory, and over 6500 waiting approval. It's becoming too time consuming. At least I have a PR7, but I would like to have a ascript that allows me to make sure that the links are Active and Linking back to me. This should do it at least every week, because I have many people that link to me, and after a few weeks remove the link. I can't keep track of it mannually, that's why I would love if any of you know a script or system to work with this issue.

tolachi

4:39 pm on Nov 17, 2003 (gmt 0)

10+ Year Member



I know that it would be simple to do using php. You should look into using curl to request the page the link is supposedly on and then regex the page to look for the requisite link. Php could flag noncompliant entries or turn them off if they are in a database.

I'm willing to be that somone on elance would write a script like this for you very cheaply.

If you don't run php a shell script and cron should do the trick. If you are running windows....

cyberair

4:55 pm on Nov 17, 2003 (gmt 0)

10+ Year Member



I'll send you a sticky mail

johannamck

5:06 pm on Nov 17, 2003 (gmt 0)

10+ Year Member



FWIW, I wrote an ASP script for this for the Windows platform.

It reads the pages via ASPHTTP, removes HTML comments (in case the link was commented out), analyzes the remaining text for the existance of the link, and writes the "no-shows" into a report file.

It would be hard to write a script that is absolutely fool-proof against cloaking though (white link text on white background and that sort of thing).

cyberair

5:17 pm on Nov 17, 2003 (gmt 0)

10+ Year Member



Well, I require them to display a banner, so it should be easy to determine whether the code was inserted. I give them a specific code they have to insert in their sites, would that make it easier to spot?

Also, I run my server on PHP/Unix so, I don't think I can use the asp, or can it?

johannamck

11:47 pm on Nov 17, 2003 (gmt 0)

10+ Year Member



The asp script has to run on an asp-enabled server. It can read and analyze the files from any server, though.

I would run it for you once for free. Sticky-mail me if you're interested.

It sounds like you're looking for a solution to run on a regular basis, though. In that case, it's better to have a script that you can run on your own server.

nakulgoyal

9:24 pm on Nov 19, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Well, I would also like this script. Stickymail me info. and I should some admin should move this into commercial forums.

DaveAtIFG

5:51 am on Nov 20, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hey nakulgoyal, leave the moderating to the staff, OK? ;)

TOS [webmasterworld.com] item 24