anyone know of script or software to check if robots can see potintial link partners?
tristo
4:08 am on Sep 5, 2004 (gmt 0)
Why not just search the engine for the URL. Then at least you can find out if the page has been indexed.
martinibuster
6:45 am on Sep 5, 2004 (gmt 0)
It's a good question if you're doing everything automated. The script would have to check robots.txt as well as meta robots.
wiredwizard
6:36 pm on Sep 5, 2004 (gmt 0)
right want it to check robot text also good point also want to be able to check a batch of diffrent URLs so doing the manual search not a desired work load lol
