Forum Moderators: martinibuster

Message Too Old, No Replies

How can I spider link partner's site for link?

Can I spider an entire site for an unknown or lost link?

         

Webdetective

3:00 pm on Jan 24, 2005 (gmt 0)

10+ Year Member



How might I spider a link partner's entire site for my link, if I am not using an automated linking system that performs automatic spidering? I am using a links directory system installed on my own site that unfortunately does not have spidering capability, and can only spider one specific page that was saved in the database. I suspect some link partners are no longer linking back to me, but searching for my links manually would be enormously time consuming and impractical. I know linksmanager performs this function well but I do not want to use linksmanager.

Is there a spidering program, preferably freeware I can use to search an entire site for a link?
Fred

elklabone

4:07 pm on Jan 24, 2005 (gmt 0)

10+ Year Member



Zeus has this ability, but it's slow.

It's just as easy to do a Google site search for your link.

--Mark

Webdetective

6:50 pm on Jan 24, 2005 (gmt 0)

10+ Year Member



I would never use Zeus. I've heard too many bad things about it, also Google frowns upon it.

Do you mean a Google search for site:www....?

I would want to spider the other person's entire site to find out where they are hiding my link, or if they are even linking back to me. I would sure hate to inactivate somebody's link by mistake, who's linking back to me.

rogerd

7:14 pm on Jan 24, 2005 (gmt 0)

WebmasterWorld Administrator 10+ Year Member



I'm sure that's what eklabone meant. It's not a bad way to conduct individual checks, but might be a problem if you want to check a thousand links.

Google frowned on Zeus link directories; they don't know and don't care about Zeus spidering (although from what I've seen it is kind of tedious).

One good thing about using Google is that it might highlight a problem, e.g., a links page that isn't reachable by site navigation or a cloaked page where the SEs don't see your link (even though it's there when you check). Of course, your link not being found could simply mean the page it is on hasn't been indexed by Google.

elklabone

3:52 am on Jan 25, 2005 (gmt 0)

10+ Year Member



Guess I was a little vague.

If you have a unique anchor text request of your partners, or a unique keyword you could search for, you could do a:

site:www.linkpartnersite.com keyword

and see if your link shows up. Again, this could get tedious if you have 1000 link partners, but if you're just checking a few it will work.

Zeus can "audit" your link partners and look for a link, but it won't find it if your partner site has 1,000 pages (zeus will give up) - but you can have it audit (for example) 20 sites overnight, then manually check the 2 or 3 that it can't find a link for.

--Mark

Webdetective

10:01 pm on Jan 25, 2005 (gmt 0)

10+ Year Member



elklabone,

I tried site:www.linkpartnersite.com keyword. Is it also possible to do the same search by link URL too?
Thanks

pmkpmk

10:03 pm on Jan 25, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



site:linkpartner.com inurl:keyword