Forum Moderators: open

Message Too Old, No Replies

Baiduspider behaving oddly

         

vgzaa

10:40 am on Aug 12, 2003 (gmt 0)

10+ Year Member



Baiduspider has recently visited my website and is acting rather weird. It starts fetching the document root and my stylesheet /css/main.css

But then it asks for the css file once more, but this time with a (random?) mix of upper and lower case letters:
/CSs/Main.CSS
...of course resulting in a 404.

Does anyone know the reason for this?

guillermo5000

5:20 am on Sep 8, 2003 (gmt 0)

10+ Year Member



Same thing just happened to my site. Any idea who Baiduspider is and what it does?

Woz

12:48 pm on Sep 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Baiduspider is the spider for Baidu.com [baidu.com], a popular Chinese search engine.

Onya
Woz

hotice_2002

1:19 am on Sep 10, 2003 (gmt 0)

10+ Year Member



Hi vgzaa, first of all, you should check your webpages and to confirm you did not write /CSs/Main.CSS in any your webpages.

Why Baidu index .css files?
As I know, Baidu is just bulding "Spam Filter System".
We know Google does not index .css files, so some seos change the H1 tag properly, then they could get a well ranking on that tag. Baidu is going to beat any kinds of spam by using CSS. But that technolgoy is not confirmed by Baidu.

Spam example:

.not_display {display:none}

Any character with not_display style, will not be seen by visitors.
I think Google spam filter system is worse on that, and I have reported that kind of spam sites more than ten times to Google, but no response.

vgzaa

7:34 am on Sep 10, 2003 (gmt 0)

10+ Year Member



Hello hotice_2002,
My code does not contain any references to /CSs/Main.CSS

Maybe the reason is that Baidu want to check which server my site is running on. MSIIS does not care much about upper and lower case, right?

BTW, my site is running Apache, and a reference to /CSs/Main.CSS instead of /css/main.css will not work - the webpage would have looked messy.

claus

8:06 am on Sep 10, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Welcome to WebmasterWorld vgzaa :)

If you use the "site search" option on top of the page you will find plenty of posts about Baiduspider. The case-issue is clearly a result of bad configuration, but personally i would not ban it just because of this.

hotice_2002, that's very interesting info, thanks :)

/claus