So they finally did it.
No doubt: along with Google FAST plays in a class of their own.
added: Hey Lazer, looks like they are still adding...
That is very impressive... and great news. Definately a class act!
It is funny that if you type url.all:http: in alltheweb, alltheweb dosen't appear on first page
Lycos shows 2,035,317,317
ATW shows 2,095,612,273
Just around 60 mio more pages at ATW. I wonder what Lycos dosen't like in the db ;)
> Just around 60 mio more pages at ATW. I wonder what Lycos dosen't like in the db
Looks like they don't like some of their competitors:
ATW #1 - Yahoo
ATW #5 - Excite
Neither in the top 20 Lycos results....
..and counting: 2,095,615,785
©2002 Google - Searching 2,073,418,204 web pages
Alltheweb.com: 2,095,615,785 web pages found
Displaying results 1-10 of
Just if you didn't know ;)
Lots of mirrors and cloaked pages in Fast. Mostly useless results when you really want to find something. Google wins on relevance. Google wins on popularity.
Fast is attempting to gain consumer popularity, but they will need to clean their results up first. Google gained in popularity because it was useful.
this morning they had "only" 1,909,540,893 Pages.
Btw. how do you know that both google and fast are not cheating with their numbers - 2 bn. seems an important number for lots of people *g*.
Another thing that makes me wonder is the change in numbers; the first post said 2.018 bn., the second post 2.035 bn. pages - this means an increased index of 35 mio. pages in some minutes? so do they update their live index? as far as i understood in different posts google updates their index once or twice a month?
You see different numbers deppending on what your preferences are too.
About the updates.
how often do they update their Index?
The last I heard (4 weeks ago) was that they Update 25% of the index every week.
So when 1 month has gone they should have updated the entire index.
They also update sites which changes itís content more often.
Also popular sites are updated more often.
fastís spider can crawl up to 150 million pages a day. They also have seperate indexes for PFI pages/sites and for the "News" index.
2.1 versus 2.07 [philly.com]
I guess Google will just have to update their presented numbers. I doubt they have not increased their database size [searchenginewatch.com] in the last six months.
By the way I tried the waybackmachine [web.archive.org] and it looks very stale for Google.
Dude all the information in that article seems to have found it's info here. I haven't seen a single press release about ATW reaching 2 billion db accept here.
WMW and the Dudes breaking real search engine news, nearly never get the credit and the source quotes they deserve ;).
Today the official press release is up:
Regular press is starting to pick up on this.
Good luck with your big deals Fast!
I think Google will mind more that they do not have the "dynamic categorisation" feature ready, than that they are missing 20 million pages.
Google recently added the possibility of searching most of the competing search engines with the same "search query" at the bottom of their SERP, just above their "shameless self-promotion" add.
My first reaction was, what a nice practical joke. On second thought I think it will serve them in two ways.
1. If searchers do side-track to another search engine and do find the page they were looking for, Google will be able to add this page (if searchers have the advanced toolbar activated) to their next crawling que, should it not have been indexed previously.
2. It is a defensive start to fence off Microsoft-like monopolistic allegations. Look at us, we are even leading the searcher to our competition!
In the same line of thought, I think that for the moment Google does not mind FAST is claiming a larger indexed database. Let the comparisons begin. Let the public and the journalists comment first, get the free publicity again.
there's one thing in the Reg article worth discussing: see this thread:
[edited by: heini at 2:19 pm (utc) on June 18, 2002]