Forum Moderators: martinibuster

Message Too Old, No Replies

Link monitoring tool

         

masum

9:08 pm on Sep 28, 2003 (gmt 0)

10+ Year Member



what is the down site Xenu Link Sleuth? somebody please tell me, is there a good side also?

heini

9:16 pm on Sep 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It's an old established free tool, which can be used to monitor links. It's quite handy to use on your own sites.
I would be pretty cautious to run it over other people's sites, as many have outright banned it.

masum

9:30 pm on Sep 28, 2003 (gmt 0)

10+ Year Member



thanks, so should I assume its a harmless tool for my own site. Somebody been using it and accessing my site quite lot 4000 only this month

pendanticist

9:30 pm on Sep 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Down side just as heini said. I think that's mostly because Xenu does not obey robots.txt unfortunately.

The up side is it's fast. Does tons and tons of links (it has/had no trouble processing my site for broken/redirected/moved links.

If you need a site map, the one prduced by Xenu is pretty nice. Simple to ammend for your own use. This feature is merely a byproduct.

I stopped using it some time back because so many sites have banned her and as a result of the bans, I found myself having to check too many 403 links manually and that just wasn't a happenin thang.

So, to make a long story short, I went with lithopssoft.com's HTML Link Validator and all my problems were solved. Relatively inexpensive and it does bookmarks too.

Pendanticist.

heini

9:33 pm on Sep 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Somebody is spidering your links and using up your bandwidth. Ban it. You can do it using htaccess. This thread will get you started:
[webmasterworld.com...]

masum

9:40 pm on Sep 28, 2003 (gmt 0)

10+ Year Member



thanks a lot, great help

nakulgoyal

11:31 pm on Sep 30, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks. This was great piece of help to me tooo.

Brett_Tabke

11:36 pm on Sep 30, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



like a lot of tools, just remember that the search engines absolutly loath these types of programs and are hyper proactive in snuffing them out.