Forum Moderators: phranque

Message Too Old, No Replies

Spider simulator

Some spider simulators return error 403 (forbidden)

         

cadh01

1:47 am on May 26, 2004 (gmt 0)



Hi,
I recently had a problem with my host server. Spiders could not crawl my site as they were rejected with 403 error message. However, my hosting company has fixed this error, and now most spider simulators (I found on the net) including the one from SearchEngineWorld, do not come back with error message anymore. But I still found 2 simulators with the same error message. One even could not recognise the meta tags. But these 2 simulators could read other sites / URLs OK. I sent an email to my hosting company with the URLs, and have not received any reply.

So far Google has not indexed my site, only the URL is diplayed and it's been about 3 months since the first submision. I also have inbound links to my site.

If Google is using the same system as those 2 simulators which could not recognise my site, then definitely I will have to change my host. Is there any other way to see if Google can actually spider my site? PS: my hosting company does not provide log file

thanks

jazzx

6:28 am on May 26, 2004 (gmt 0)

10+ Year Member


hi cadh

welcome to webmasterworld.
if you're running on apache - looks like you have to check your .httaccess file for exclusions or ip denials.

hope this helps
jazzx