Welcome to WebmasterWorld Guest from 54.205.20.160

Forum Moderators: open

Message Too Old, No Replies

Language distribution in FAST's index

Find out how many pages from your language are listed

   
9:26 pm on Jun 24, 2002 (gmt 0)

WebmasterWorld Senior Member heini is a WebmasterWorld Top Contributor of All Time 10+ Year Member



As of June AlltheWeb has the largest index worldwide with nearly 2,1 Bill indexed pages.
Like all major search engines FAST caters to users worldwide. ATW supports queries from 49 languages - listed on ATW are however only 47.

Here's the breakdown on language distribution in the webpages index of AlltheWEb:

1.262.454.156 English #1
132.021.159 German #2
121.711.668 Japanese #3
60.416.115 French #4
48.290.492 Korean #5
46.193.132 Russian #6
44.796.766 Chinese(simpl) #7
41.755.139 Spanish #8
37.037.709 Italian #9
35.954.497 Portuguese #10
29.975.574 Dutch #11
18.843.492 Polish #12
16.802.167 Swedish #13
14.398.169 Czech #14
14.010.982 Chinese (trad) #15
12.931.353 Danish #16
9.515.814 Norwegian #17
7.732.831 Finnish #18
4.971.862 Slovak #19
4.713.927 Hungarian #20
4.110.912 Turkish #21
2.286.717 Greek #22
2.059.161 Thai #23
1.926.977 Estonian #24
1.872.409 Catalan #25
1.870.862 Slovenian #26
1.696.489 Croatian #27
1.623.515 Hebrew #28
1.434.400 Indonesian #29
1.300.343 Ukrainian #30
1.151.788 Romanian #31
1.113.346 Icelandic #32
1.076.696 Bulgarian #33
1.043.059 Lithuanian #34
898.984 Arabic #35
686.251 Latvian #36
467.247 Malay #37
334.003 Galician #38
226.089 Africans #39
223.646 Basque #40
160.527 Latin #41
150.102 Faeroese #42
110.438 Vietnamese #43
100.665 Welsh #44
92.439 Frisian #45
68.169 Albanian #46
66.051 Byelorussian #47

6:49 am on Jun 25, 2002 (gmt 0)

WebmasterWorld Administrator bill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



It's sad to see all that Japanese sitting in there with no Japanese interface for the masses :(

Fast appear to be cleaning up the Japanese SERPS though. I read that last week they had about 139 million Japanese pages indexed (that's a 13% drop) and have killed a lot of duplicate pages.

3:37 am on Jun 26, 2002 (gmt 0)

10+ Year Member



Agreed, bill. I would really like to see them put up a Japanese front end.
4:48 am on Jun 26, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



excellant collection of data there Heini,

knew german was the second biggest online language, did not realise how big Japanese is, but i suppose it makes sense, as they have the second highest search rate in the world.

I thought Spanish would be higher.

8:52 am on Jun 26, 2002 (gmt 0)

WebmasterWorld Senior Member heini is a WebmasterWorld Top Contributor of All Time 10+ Year Member



>japanese
Bill, that's interesting. A major purge in japanese pages... in a time of massive index growth
Those figures, do you know how up to date they were?

Daicon: sorry, no language interfaces for ATW in the near future, I'm afraid.
We can only hope for FAST to get a portal deal in Japan.

>Spanish
I was astonished too, especially given FAST's connection with Terra/Lycos.
Perhaps Msgraph can shed a light on this.

5:23 am on Jun 27, 2002 (gmt 0)

WebmasterWorld Administrator bill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



>japanese
Bill, that's interesting. A major purge in japanese pages... in a time of massive index growth
I got the impression that they cleaned out a lot of junk. Some of the terms I watch have cleaned up results, particularly duplicate pages. Maybe they're prepping better results as window dressing for Yahoo?
Those figures, do you know how up to date they were?
I got that from a report released this week on a Japanese language site that tracks this sort of minutia. It's pretty fresh and I believe the data is reliable.
10:32 am on Jun 27, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>> Here's the breakdown on language distribution in the webpages index of AlltheWEb

I'll bet you could mirror this distribution with the economic strenght of associated nations.