Hello i am getting alot of errors from my logs 30,000 to be exact which are coming from search engines . I do have a cloaking script up which directs spiders to folders that contain doorway pages , any ideas why this is happening
thanks
toolman
2:27 pm on May 29, 2001 (gmt 0)
Are there links on those cloaked pages that look like this perhaps......
../google/pix.gif
wayne
2:37 pm on May 29, 2001 (gmt 0)
no none at all , like that
toolman
2:53 pm on May 29, 2001 (gmt 0)
Do you have a robots.txt file?
wayne
2:57 pm on May 29, 2001 (gmt 0)
no robot.txt file on the doorways at all , just basic meta tag set up
toolman
3:25 pm on May 29, 2001 (gmt 0)
What kind of errors are they?
wayne
3:55 pm on May 29, 2001 (gmt 0)
they are all 404 page not found .... I cant figure it out
toolman
4:01 pm on May 29, 2001 (gmt 0)
Post a couple of the errors from the logs if you would and let's see what they look like.
