Nested 404 urls from spiders

messing up my webtrands stats

[BDC]

I'm getting lots of 404s in my clients log files which look like they are coming from spiders. I'm not sure if it's a problem with the spider or my code is confusing it, has anyone come across the same problem?

The correct url is:
www.cypress-software.com/company/company_contact.asp

But I'm getting 404 logs from scooter like:
www.cypress-software.com/customers/customers/company/company/company/company/company/customers/company/company_contact.asp

Loads of them which seem to be all unique. Any ideas?

BDC ;-)

[Brett_Tabke]

Is this on a page of generated content? The only time, I've seen that, is when a script messed up on my end.

[jatar_k]

have you actually looked through the logs to see if there is a pattern to it?

Might be able to point out a code issue if you can see the url slowly build up to that big mess. You may be able to see what page it was coming from when that started.

[BDC]

I'll go through the log files and check my scripts.

Yes there is a lot of generated content on the site. It's bound to be my code mucking things up somewhere as I don't get this problem in the other directories.

I'll post when I have a better idea, Thanks for the help.

BDC ;-)

[BDC]

I think it's something to do with my 404.asp code.

The web server doesn't seem to direct to the 404 in the root directory by deafult for every type of file, so I'm getting a 404 page with a URL which is not the root. When the 404 redirects it can't find the right directory and loops.

My fault for having a 404.asp with too much code in it.

Thanks for your help with this.

BDC ;-)