Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Google Crawling CSS files

have you noticed it?

         

le_gber

8:03 am on Jun 28, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi there,

I read on another forum that Google started crawling CSS files. I checked my log files and couldn't get confirmation of this.

Any of you noticing anything similar in your own log files?

le_gber

6:07 pm on Jun 29, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



got it:


66.249.66.239 - - [23/Jun/2006:03:29:09 +0100] "GET /xyz.css HTTP/1.1" 200 6563 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

So how long has it been going on? Are they going to start parsing CSS files? I always thought it would take up too much resource to do it and be useless (as you can hide stuff with Javascript as well).

xyz.css is to hide my site name

tedster

8:32 pm on Jun 29, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I've seen googlebot crawl css files occasionally for quite a while now (couple years it seems), but not as a routine action.

brizad

10:32 pm on Jun 29, 2006 (gmt 0)

10+ Year Member Top Contributors Of The Month



By default my htaccess is set to dissallow spiders from /images and /cgi-bin so now I guess I'll have to add /css too.

le_gber

8:06 am on Jun 30, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



it seems that on the 23rd it did crawl quite a large amount of sites. That's the date reported by other people seeing this as well.