Forum Moderators: phranque
So when the server get a request of
http://domain/widgets/1,ID23/balabala.html, it will run widgets.php to handle the request. I noticed that these days when Googlebot/2.1 try to crawl my pages, most of the request besides '/' return 302 code to Googlebot, but just last week, they could return 200 code to Googlebot.
The following are a sample of the logs:
64.68.82.169 --- GET /widgets/1,ID23/Blue_Widget.html HTTP/1.0" 302 0 "-" "Googlebot/2.1
64.68.82.201 --- GET / HTTP/1.0" 200 3480 "-" "Googlebot/2.1
64.68.82.170 --- GET /widgets/12,ID813/Red_Widget.html HTTP/1.0" 302 0 "-" "Googlebot/2.1
I guess it is because Googlebot has just changed its behavior, if I remove the 'Options MultiViews', it will not work.
Somebody told me that I should use 'Options +FollowSymLinks' , so what is the different between
'Options +FollowSymLinks' and 'Options MultiViews' in apache server .htaccess setting?
I might try:
<FilesMatch "^widgets$">
Options MultiViews
Options +FollowSymLinks
ForceType application/x-httpd-php
</FilesMatch>
to see what is going on Googlebot next day.
Anybody have idea?