Welcome to WebmasterWorld Guest from 54.162.12.134

Forum Moderators: phranque

Message Too Old, No Replies

How does Googlebot handle custom server response codes?

     
11:55 am on Jun 24, 2009 (gmt 0)

5+ Year Member



I have run into an issue that I cannot find much relevant information on.

One of my clients is running 3rd party software on their site to prevent malicious hacker attacks. If the software identifies an attack (through HTTP), it will return a "301 Denied" response and then does a redirect. This instead of the tradition "301 Moved Permanently"

Does anyone know what Googlebot will "think" about this? (I hesitate to use the word respond or react as I assume the redirect will still happen.) We have had some issues with failed redirects in the past that have caused "Network Unreachable" errors. I need to make sure that Googlebot does not view this server response as invalid and flag the page as a "Network Unreachable" error.

If you are wondering how Googlebot will ever see this type of error, certain incorrectly marked-up HTML links to the site can invoke the defense code on the server.

I thank everyone reading this for their time and appreciate any thoughts/experience on the subject.

Thanks!
Jim

12:25 pm on Jun 24, 2009 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member



The "text" of the server response does not matter. It is the numerical code that has "meaning" to machines.

However, it is an error to return a 301 when a 403-Forbidden response is called for. Be aware that many (or most) "malicious" clients won't follow a redirect.

Jim

12:49 pm on Jun 24, 2009 (gmt 0)

5+ Year Member



Thanks Jim. I had a feeling you would be the one to answer my question.

We had a 403 in there at first, but given our current situation we need a 301, as it is Googlebot that I am concerned about. Our security team are the ones who need to deal with the malicious clients ;).

Thanks again.

1:17 pm on Jun 24, 2009 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Non-malicious incorrectly-formatted links should be 301-redirected (if possible) to a corrected URL, and only maliciously-coded links (e.g. query string injection attempts) should get a 403. If it's not possible to correct malformed links, then a 404-Not Found is appropriate.

Jim

 

Featured Threads

Hot Threads This Week

Hot Threads This Month