Forum Moderators: martinibuster

Message Too Old, No Replies

link checker

link checker

         

amythepoet

3:11 pm on Dec 3, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



HI,

C an you recommend a link checker so I don't have to personally go through them all, it's getting a bit too much!

Leosghost

3:38 pm on Dec 3, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



xenu link slueth
[home.snafu.de...]

amythepoet

6:48 pm on Dec 3, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks, I just looked and it won't run a Mac!

Now what?

Leosghost

6:57 pm on Dec 3, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



you need to get a cheap PC if you want to make sites ( and have access to most of the apps that are pc based ) ..most of your visitors are using them ..

will it not run in wine?

ask in the mac fora ( always the best place to begin if you are asking about apps if you are running a mac )

cnvi

4:55 pm on Dec 5, 2006 (gmt 0)

10+ Year Member Top Contributors Of The Month



I've tried the majority of downloadable link checking programs available on the web.. Only a small handful of them work fine for small sites. I found the vast majority that exist to consume alot of resources and not abide by robots.txt which can upset fellow webmasters.

Link checking must be done carefully so you don't overcrawl other webmasters sites. Also you want to utilize a link checker which abides by robots.txt.

If you have a large number of clients or a large site to check, you might want to consider an ASP (application service provider). There are many available on the web. You can find then by googling "link checker application service provider". ASPs are favorable because there is typically no download to install.

Link checking can consume alot of hardware and bandwidth resources. My own company owns three dozen apple xservers in three data centers. Their sole job is link checking for our clients. It's a massive task that should not be taken lightly because you need to be sensitive to other webmasters bandwidth considerations and abide by robots.txt. Spider too often - that can produce complaints by webmasters. Spider less frequently, results suffer. It's a delicate balance that most downloadable softwares fail to manage optimally.

If you do decide to go with a downloadable software, use one that utilizes a cache which will lower demand on the sites you are checking and also optimize link checking speed. To find those, google "link checker download cache".

whoisgregg

5:13 pm on Dec 5, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Amy has posted her question in the mac forum [webmasterworld.com] and she's looking for a tool to check reciprocal links, not to check for broken links on her own site.

you need to get a cheap PC if you want to make sites ( and have access to most of the apps that are pc based ) ..most of your visitors are using them

You don't need a PC to run windows applications. There's been quite a few developments in the area of virtualization on Macs since wine. ;)

You can use Boot Camp [apple.com] on any Intel-based Mac to install a fully-functional dual-bootable version of Windows. With the new version of Parallels [parallels.com] coming out, you'll be able to use your boot camp disk image and open that in a window in your mac. You can also just install Windows for use by Parallels, but then you can't dual-boot.

jakegotmail

7:09 pm on Dec 5, 2006 (gmt 0)

10+ Year Member



heh good to see there is a need. Im currently developing a tool to confirm backlinks are in place. Obv this isnt the forum to promote so my hands are tied :)

martinibuster

7:52 pm on Dec 5, 2006 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Right.
Step 1: Speak at industry conferences, particularly Link Dev Panels
Step 2: Give away software to influential bloggers etc.
Step 3: Make t-shirts and wear them at conferences and events

I don't check partner backlinks because I don't have that many partners anymore. I do use Xenu link checker, but it's not a backlink checker.

Leosghost

9:39 pm on Dec 5, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



whois gregg ..yeah I know but amy didnt say that 2 days ago ..

BTW I know that mac has moved on ..But as I only use one old one to check on dev pages .."bait" was better ..most people know more about macs than I do ..

amy ..you really have go to to be more precise in expressing what you want to know and want your site to do ..and to accept that it isn't all out there for free , and automated ..if you want your site to be sucessfull you need to work at it yourself ..and read fully the links which are presented in answer to your questions..like webwork said the other day ..

there are no quick and good ways that are to be found by simply asking "how can I do this" many times and hoping that it will all fall from the sky in a recognisable pattern ..

and you'll learn more by thinking and trying stuff for yourself ..

BTW anyone who has so many backlinks that they dont have the time to check them ..either has so many they dont need to bother ( they must be at #1 for all their keywords and phrases already )..or is doing recip links to anything that will open in a browser ( wether related to their sites topic(s) or not ..( bad idea )...or ( and I dont mean this unkindly ) needs to knuckle down and realise that succesfull websites dont get built by themselves ..or by other fora members responses ..

You have to do some of the lifting yourself ..you do ..it'll make you and your site stronger ..or take out the check book ..ther are shortcuts to having a successfull site ..but they aint free ..and learning how to do it yourself an dactaully spending the time trying stuff out is much more satisfying ..try it it ..eventually you'll agree :)

cnvi

1:40 am on Dec 6, 2006 (gmt 0)

10+ Year Member Top Contributors Of The Month



you guys just gave me a great idea.. maybe I should produce a free link checker. that would not last long.. I doubt anyone would use something that is "free". too fishy.

martinibuster

1:46 am on Dec 6, 2006 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



A good way to get links, cnvi. Look how long a rudimentary app like Xenu has held on.

cnvi

2:34 am on Dec 6, 2006 (gmt 0)

10+ Year Member Top Contributors Of The Month



I have but its limited for expansion IMO.

cnvi

3:58 pm on Dec 6, 2006 (gmt 0)

10+ Year Member Top Contributors Of The Month



I may have misunderstood the original question.. Xenu to my knowledge is a link checker designed primarily to locate broken links for a single domain per run.

I was referring to full service link checking.. something that would check a list of links for broken links, 404 vs parked domain, and for link reciprocation.

amythepoet

1:18 am on Dec 7, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Dear Leosghost,

I am trying stuff for myself, and I am willing to pay, I have paid mucho dollars in the past

I am learning a lot from all you wonderful webaholics,

I wasn't asking for free, I am trying my hardest and appreciate your help

thank you and I have posted the question in the mac forum also

what I was looking for a link checker to see if my link partners were reciprocating in kind.

Leosghost

9:15 am on Dec 7, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



it's not really a question of how much one has paid or is willing to pay ..it's when one needs help one does need to try to formulate a clear precise question..that makes sense

..that helps enormously if you want an answer that makes sense ..

..and to do something with the answers one gets

.. ..sometimes it feels like pulling teeth..

axgrindr

2:45 pm on Dec 7, 2006 (gmt 0)

10+ Year Member



what I was looking for a link checker to see if my link partners were reciprocating in kind.

Instead of finding a program to check up on your reciprocal links after the fact why not install some proper reciprocal link software that automatically does this for you?

The script I am currently using checks everyday if any of the reciprocal links have dropped and promptly removes them from the directory if they have, then sends the webmaster of the site an email, then puts the link back in the directory when it finds it on their site again.
There are tons of inexpensive scripts out there that can do this and many of them will import your existing list of rlinks as well.

(sticky me if you need a referral)