Forum Moderators: martinibuster

Message Too Old, No Replies

Reciprocal link checker?

Anything that crawls the whole site?

         

moehits

10:08 pm on Feb 22, 2005 (gmt 0)

10+ Year Member




Sorry if this has been covered before.
Are there any programs that will crawl entire sites looking for reciprocal links?

I thought I remembered seeing a program that takes a list of sites and crawls all their pages looking for your link, but lost the bookmark.

nuevojefe

1:22 am on Feb 23, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Not sure about what's out there, but a programmer can create a spider for this pretty easily.

I would suggest finding a better way to do this *especially* if you're going to use it on a regular basis as it can get bandwidth intensive for the sites you crawl.

moehits

8:14 pm on Feb 23, 2005 (gmt 0)

10+ Year Member




I just want to use it for new clients, I'll look around, I'm pretty sure there's a good windows program already out there that's cheap. Make vs buy decision.

neuron

7:00 pm on Feb 24, 2005 (gmt 0)

10+ Year Member



reciprocal link checker

it can really eat up some bandwidth though. i had to stop using it when I roughly and optimistically calculated that I needed at least 4.2 TB of bandwidth per month to check for my links.

Instead. I just use the search engines to check for links and had my programmers write a script that crawls all the major engines looking for my links. Besides, I want all my links to be found by the search engines anyway.