homepage Welcome to WebmasterWorld Guest from 54.198.224.121
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld
Visit PubCon.com
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

    
googlebot problems - http 302 results for my pages.
Googlebot Mod Rewrite 302 Apache
marcusmiller




msg:46777
 12:39 pm on Jan 21, 2003 (gmt 0)

Hi all

we have had this problem for some time now, on and off and I just can seem to find a fix for it. Hopefully someone will be able to offer me an explanation or point me in the direction of some further info.

We use rewrite rules for some of our pages -
{
RewriteEngine On
RewriteBase /

RewriteRule ^(.*)ringtones/(.*)$ $1tones.php/$2
RewriteRule ^(.*)ringtones2/(.*)$ $1tones2.php/$2
}

The google bot comes to our page and a request is made for:
/ringtones/xxxxxxxxxx.htm
is directed to:
/tones/xxxxxxxxx.htm

The above works fine, all pages return a 200 ok result.

The googlebot comes to our page and a request is made for:
/ringtones2/xxxxxxxxxx.htm
is directed to:
/tones2/xxxxxxxxx.htm

This fails and returns a 302. Then another request is made that for all purposes seems identical and a '200 ok' is returned.

This is what I see in my web logs.
{
www.ringtones-direct.com 64.68.82.67 - - [20/Jan/2003:04:04:37 +0000] "GET /ringtones2/artist-Foo-Fighters-Times-Like-These.htm HTTP/1.0" 302 263 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
www.ringtones-direct.com 64.68.82.67 - - [20/Jan/2003:04:04:40 +0000] "GET /ringtones2/artist-Foo-Fighters-Times-Like-These.htm HTTP/1.0" 200 34320 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
}

Now the real curious part is this:
I have tried and tried to simulate the failed request at the command line in a telnet client and every request I make returns a 200 ok! The only way I can get this to fail is to exclude the 'Host' from the http request. Googlebot includes the Host field so this should not be the case.

I am totally stumped with this one, If anyone can help you would make my year!

Thanks for reading
Marcus

 

marcusmiller




msg:46778
 3:19 pm on Jan 21, 2003 (gmt 0)

This problem has changed somewhat...

The initial request is for the .co.uk version of the site and it forwards to the .com site creating the redirect.

My problem is now to do with how I have the DNS setup for the main site, the .com version and for the .co.uk address which purely forwards to the .com site.

Can anyone help me here? If so I can provide a few more details.

Thanks all
Marcus

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved