Forum Moderators: open

Message Too Old, No Replies

Can Googlebot and other spiders index unicode?

         

FleaPit

2:41 pm on Apr 29, 2003 (gmt 0)

10+ Year Member



Anyone know if Googlebot can read unicode or other spiders for that matter? Can they translate it to html or do they just index the actual characters i.e. nonsense!

Brett_Tabke

10:33 pm on Apr 30, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



It's not that hard of a issue to detect after some searching at Google. Yep - unicode is being read and indexed.

g1smd

5:48 am on May 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Valid HTML code means that you define the Character Encoding in the <head> section:

<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">

I'd be surprised if spiders didn't check that entry.