Welcome to WebmasterWorld Guest from 22.214.171.124
Forum Moderators: martinibuster
How do I monitor that those website link to me if the number of sites become unmanageable - over a 200/300 or so?
I thought of designing a piece of software working a bit like an SE spider - on one end I feed the URL's that it should spider to see if the link to my site is there - on the other it lists the code for the site that do (to check anchor text etc...) and the sites that don't have the link anymore.
The only problem is ... I have NO CLUE on how to do that.
Anyone knows how to build a search engine spider?
Because there are paid services like this, but I guess not one free.