Forum Moderators: IanTurner & engine

Message Too Old, No Replies

Mirago

its spider and spidering..

         

mr_dredd2

3:54 pm on Jun 25, 2001 (gmt 0)

10+ Year Member



Does anyone know what the mirago spider is called? can't find it anywhere..

also, has anyone experienced any weird mirago spidering recently? For example, for one of my sites, it has spidered through my folders, but then resolved the url without the folder name - e.g.
www.mysite.co.uk/myfolder/mfile.html
is showing in mirago as
www.mysite.co.uk/mfile.html

and obviously a 404... bizzare!!!

anyone else??

jimmykav

5:04 pm on Jun 25, 2001 (gmt 0)

10+ Year Member



I seem to remember it was something along the lines of
henry/the mirago robot

engine

7:43 am on Jun 26, 2001 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Jimmykav is perfectly correct.

HenryTheMiragoRobot,217.33.60.249

I'd not spotted that spidering pattern. If you're getting 404s I'd report it to them here [mirago.co.uk...]
as 404s are no good to them or to you.

mr_dredd2

8:12 am on Jun 26, 2001 (gmt 0)

10+ Year Member



thanks v much guys!

carlwright

1:31 pm on Jun 26, 2001 (gmt 0)

10+ Year Member



I once had the thing looking for files that never existed on one of my sites, never have and probably never will (about 100 seperate docs) - I did tell them but heard nothing back