link crawler scripts or programs

Any programs that will crawl a domain looking for a link?

[moehits]

I'm trying to find a program that will search an entire domain to see if there is a link to my site on it, anyone know of anything?

Checking the search engines is unreliable, and going through them by hand is too time consuming.

I'm looking for something to see if domain A has a link on any of it's pages to domain B.

[vrtlw]

This would be really interesting to find.

Ive been on the lookout for a script like this for a long time, not had a lot of luck as yet - perhaps I should start putting the programming skills I have recently learnt to work :)

[DaveAtIFG]

Have you looked at these [hotscripts.com]?

[vrtlw]

I have, I actually tested a large amount of scripts like these and made my purchase accordingly.

The script that I have has a reciprocal link checker, but it only checks 1 URL. What I would like to do is specify a start page and then let the reciprocal link checker spider all pages down from there (staying on the domain of course).

I think I am going to try and make a mod to the code that I already have and see what I can come up with.

[bobbee]

Snoopy (PHP) will spider a domain and return a list of links:

ht**tp://sourceforge.net/projects/snoopy/

You can then search the returned list for your domain name, etc.

hth,

Bob

[manwah]

i brought Automate Link Exchange from linkautomate.com and it can do that. But it advised me 2 things:

1. better to put the exact link or partner's link directory homepage in the reciprocal link field.

2. If the software can still can't crawl it, likely 2 scenario:

a. the link is buried too deep. Don't link with them as it doesn't help

b. or even non-exist.