site not being crawled by spiders

[whodat]

I'm new to SEO. One of our clients asked us about optimizing their site. From the webtrends reports, I saw that no spider except Google has visited the site since the beginning of 2003.

I've asked the ISP for the robots.txt file but I'm assuming that it wouldn't be excluding the other spiders.

I'm certainly no expert but from looking at the site and code, I don't see why the site could have been banned. Someone did point out to me that if you go to [example.com...] you wind up at [example.com...] I don't know if this could cause a problem. He said that the main page should be directly under [example.com...]

Does anyone have any ideas on what could cause this? Or other things that I could investigate to find out?

Thanks,

whodat

[edited by: pageoneresults at 8:07 pm (utc) on Mar. 24, 2004]
[edit reason] Removed URI References - Please refer to TOS [/edit]

[whodat]

I neglected to mention that this site is about 4 years old and it shows up in AskJeeves, Yahoo, AllTheWeb and DogPile as well as Google. These are the only ones I've checked.

And interestingly, in DogPile, an actual error message shows up in the listings. The ISP recently changed from using .jsp extensions to using .cvsp extensions. These errors only started showing up about two weeks ago. If you clicked on an old .jsp listing in Yahoo, you would get the error.

So, DogPile must have indexed the site recently but it doesn't show up in the logs.

whodat