Welcome to WebmasterWorld Guest from 23.20.147.6

Forum Moderators: open

Message Too Old, No Replies

Language distribution in FAST's index

Find out how many pages from your language are listed

     
9:26 pm on Jun 24, 2002 (gmt 0)

Senior Member

WebmasterWorld Senior Member heini is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Jan 31, 2001
posts:4404
votes: 0


As of June AlltheWeb has the largest index worldwide with nearly 2,1 Bill indexed pages.
Like all major search engines FAST caters to users worldwide. ATW supports queries from 49 languages - listed on ATW are however only 47.

Here's the breakdown on language distribution in the webpages index of AlltheWEb:

1.262.454.156 English #1
132.021.159 German #2
121.711.668 Japanese #3
60.416.115 French #4
48.290.492 Korean #5
46.193.132 Russian #6
44.796.766 Chinese(simpl) #7
41.755.139 Spanish #8
37.037.709 Italian #9
35.954.497 Portuguese #10
29.975.574 Dutch #11
18.843.492 Polish #12
16.802.167 Swedish #13
14.398.169 Czech #14
14.010.982 Chinese (trad) #15
12.931.353 Danish #16
9.515.814 Norwegian #17
7.732.831 Finnish #18
4.971.862 Slovak #19
4.713.927 Hungarian #20
4.110.912 Turkish #21
2.286.717 Greek #22
2.059.161 Thai #23
1.926.977 Estonian #24
1.872.409 Catalan #25
1.870.862 Slovenian #26
1.696.489 Croatian #27
1.623.515 Hebrew #28
1.434.400 Indonesian #29
1.300.343 Ukrainian #30
1.151.788 Romanian #31
1.113.346 Icelandic #32
1.076.696 Bulgarian #33
1.043.059 Lithuanian #34
898.984 Arabic #35
686.251 Latvian #36
467.247 Malay #37
334.003 Galician #38
226.089 Africans #39
223.646 Basque #40
160.527 Latin #41
150.102 Faeroese #42
110.438 Vietnamese #43
100.665 Welsh #44
92.439 Frisian #45
68.169 Albanian #46
66.051 Byelorussian #47

6:49 am on June 25, 2002 (gmt 0)

Administrator from JP 

WebmasterWorld Administrator bill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Oct 12, 2000
posts:14966
votes: 125


It's sad to see all that Japanese sitting in there with no Japanese interface for the masses :(

Fast appear to be cleaning up the Japanese SERPS though. I read that last week they had about 139 million Japanese pages indexed (that's a 13% drop) and have killed a lot of duplicate pages.

3:37 am on June 26, 2002 (gmt 0)

New User

10+ Year Member

joined:Dec 13, 2001
posts:39
votes: 0


Agreed, bill. I would really like to see them put up a Japanese front end.
4:48 am on June 26, 2002 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 21, 2001
posts:2491
votes: 0


excellant collection of data there Heini,

knew german was the second biggest online language, did not realise how big Japanese is, but i suppose it makes sense, as they have the second highest search rate in the world.

I thought Spanish would be higher.

8:52 am on June 26, 2002 (gmt 0)

Senior Member

WebmasterWorld Senior Member heini is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Jan 31, 2001
posts:4404
votes: 0


>japanese
Bill, that's interesting. A major purge in japanese pages... in a time of massive index growth
Those figures, do you know how up to date they were?

Daicon: sorry, no language interfaces for ATW in the near future, I'm afraid.
We can only hope for FAST to get a portal deal in Japan.

>Spanish
I was astonished too, especially given FAST's connection with Terra/Lycos.
Perhaps Msgraph can shed a light on this.

5:23 am on June 27, 2002 (gmt 0)

Administrator from JP 

WebmasterWorld Administrator bill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Oct 12, 2000
posts:14966
votes: 125


>japanese
Bill, that's interesting. A major purge in japanese pages... in a time of massive index growth
I got the impression that they cleaned out a lot of junk. Some of the terms I watch have cleaned up results, particularly duplicate pages. Maybe they're prepping better results as window dressing for Yahoo?
Those figures, do you know how up to date they were?
I got that from a report released this week on a Japanese language site that tracks this sort of minutia. It's pretty fresh and I believe the data is reliable.
10:32 am on June 27, 2002 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:June 29, 2000
posts:1133
votes: 0


>> Here's the breakdown on language distribution in the webpages index of AlltheWEb

I'll bet you could mirror this distribution with the economic strenght of associated nations.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members