Welcome to WebmasterWorld Guest from 54.167.83.224

Forum Moderators: open

Message Too Old, No Replies

AlltheWeb reaches 3 billion page index

Massive competing with Google again.

     
10:28 am on Aug 20, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 16, 2001
posts:2059
votes: 0


1 - 10 of 3,048,540,854 Results for url.all:http:

Says itself, well done FAST team.

I think this will probably make google change the number on their frontpage in not to distant future.

6:25 am on Aug 26, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member vitaplease is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Dec 11, 2001
posts:2725
votes: 0


nice one mcavic,

it really seems as if Google waited on purpose before releasing.. ;)
good to know there really are some young guys working at Google.

and then, as always, there's some left in the search for "the".

12:24 am on Aug 27, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:June 1, 2003
posts:81
votes: 0


I agree with you, vitaplease.

For a Google search on "the", I get a count of 3,480,000,000 billion web pages.

The same search on AllTheWeb shows 1,316,623,131 web pages.

So Google seems to be bigger than they say and AllTheWeb may well be smaller.

Barry Welford

8:56 am on Aug 27, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 21, 2003
posts:172
votes: 0


Does the No. really count? IMO, it's the SERP quality which counts. Searchers won't even check the results on the second result page. What is the point if ATW shows 198,000 results or Google shows 285,000 results? I do believe ATW has a future. The money Overture spent on it won't be wasted. Probably its result will be incorporated with Alta vista and Inktomi. Yahoo is going to be a meta search engine! :o
9:06 am on Aug 27, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Sept 21, 2002
posts:227
votes: 0


IF Search Results RELEVANCY COUNTS, Google is still # 1, and will be, I suspect, for some time. I just don't see All the Web as being close, or any others. But it's good to have competition there.
12:57 pm on Aug 27, 2003 (gmt 0)

Moderator from DK 

WebmasterWorld Administrator 10+ Year Member

joined:Oct 23, 2000
posts:2530
votes: 1


Overture Launches World's Largest Search Index; FAST Index of 3.2 Billion Documents Demonstrates Overture's Commitment to Industry-Leading Web Search Technologies

Press release [corporate-ir.net]
6:53 am on Aug 28, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 2, 2002
posts:792
votes: 0


I am very suspicious of the numbers released by alltheweb:
1. I doubt their index is as big, cause they don't have many pages indexed that are commonly found on Google. And we all know that Google does a through job of indexing a site.

2. Alltheweb's index is STALE. Do a search on any subject in Google and you will find pages that have been added upto 2 weeks back, even if they are deep. The same search on FAST dosen't even show pages from 2 months back.

3. Possibly they are fresh indexing some pages, but by and large their index is stale.

7:59 pm on Aug 28, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:June 29, 2000
posts:1133
votes: 0


Google was like Fast not long ago ... good technology but low visibility, until Yahoo took them mainstream.

By the way, who is it that owns Fast now?

10:24 pm on Aug 28, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Sept 21, 2002
posts:227
votes: 0


Who owns FAST? Overture according to an earlier post (#35, from Rumbas). But Overture still uses Inktomi results after its paid listings when you use the Overture search engine itself. So go figure .....
10:39 pm on Aug 28, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Aug 29, 2002
posts:260
votes: 0


Google was like Fast not long ago ... good technology but low visibility, until Yahoo took them mainstream.

But this was in a time when Yahoo was the dominant web brand - which now is Google. Just the bare fact, that Yahoo will now support ATW doesn't mean that ATW will rise as high as Google did then.
10:45 pm on Aug 28, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Aug 29, 2002
posts:260
votes: 0


I am very suspicious of the numbers released by alltheweb: I doubt their index is as big

I just saw that ATW has now about three times more pages from my website indexed than Google has. Really surprising. Especially because most of my pages are dynamic with the bad "?" in the URL ...

11:52 pm on Aug 28, 2003 (gmt 0)

Junior Member from AU 

10+ Year Member

joined:Oct 20, 2001
posts:167
votes: 0


Greetings and Gidday all,

if ATW is the biggest, why am I seeing included in ATW SERPs, urls that only G is constantly (and driving me cazy with!) indexing and including in their DB?

(I checked the ATW DB and they report those pages not in their index, but they gotta be pulling them from somewhere!) {:-]

Baffled.
JP

8:34 am on Aug 29, 2003 (gmt 0)

New User

10+ Year Member

joined:Aug 20, 2003
posts:9
votes: 0


I have found ATW results to be far better than Googles. The results are up to the point. I tried searching in for some of my keywords. The results were completely different than Google and IMO far better - not just because I was ranked well ;)

I wonder what is the algo that ATW uses. It gives amazingly accurate results according to their importance. The best part - CONSISTENCY!

9:42 am on Aug 29, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Aug 29, 2002
posts:260
votes: 0


There is one thing I really don't like with ATW now: Their sponsored results look nearly identical as the real results. Google is more honest in this case.
10:57 pm on Aug 29, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 8, 2002
posts:2335
votes: 0


Google has updated their homepage:
2003 Google - Searching 3,307,998,701 web pages

[businessweek.com...]

Forums are getting more interesting these days now that reporters have learned they are the best place to find out the latest and greatest about any topic. I've seen many stories started here. Been approached by reporters from here and I wouldn't be surprised if one or two stories came out of this very thread. Then the reporters come back here for the update ;)

Hi guys!

5:33 am on Aug 30, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Aug 15, 2003
posts:67
votes: 0


What I'm wondering is, how did these guys get first hit in AlltheWeb for url.all:http:?

[edited by: Rumbas at 10:22 am (utc) on Aug. 30, 2003]
[edit reason] No url's please! Thanks [/edit]

6:31 am on Aug 30, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Sept 21, 2002
posts:227
votes: 0


Let's see if I can figure this out: Overture owns FAST, and also owns Alta Vista, but Overture uses Inktomi results after its paid listings. I suppose integrating search results takes time, but ...........?

Then: Soon (if not already?) Yahoo, which was a directory, but using Google search results, will own Overture. Now -- for the future: what results are going to show on Overture, and on Yahoo? And how the heck can Yahoo make money after swallowing Overture with its recent FAST and AltaVista acquisitions -- two search engines hardly anyone uses (at least in the US)?

I think Yahoo has bought (or will buy) one great big lemon, except for Overture revenues from paid ads.

But the thing about that revenue is that probably half of that present revenue is paid for by Yahoo itself, since it is either #1 or 2, depending on who you trust for stats, for searches on the Internet, and it receives revenue from Overture for the listings on the Yahoo portal.

I suppose buying Overture is one way to "pay yourself," if you are Yahoo, but it still leaves little profit from Overture paid ads if you are already the owner of half the revenue from those.

6:33 am on Aug 30, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Sept 21, 2002
posts:227
votes: 0


re previous post where it says:

"paid for by Yahoo itself,"

It should say

"already received by Yahoo itself from Overture."

6:39 am on Sept 7, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 19, 2003
posts:1001
votes: 0


I've also really been impressed with alltheweb recently. Great results, and they're really busy trawling my site. However, I don't think the number of pages in their index is so significant.

I've noticed in previous months that alltheweb has a much bigger problem with trivial duplicate pages in its index. I.e., www.mysite.com, www.mysite.com/index.html, and mysite.com will all show up in the SERPS. A good number of these 3 billion and what will be duplicate pages.

Another note: someone's been trawling one of my directories that's got way - ugly mulitple paramater url's for all its pages, and though I haven't looked though my logs carefully, I've got all reason to believe this is alltheweb (this would also be consistent with what others have reported on it). However, though probably being trawled, they aren't showing up in SERPS.

11:10 am on Sept 11, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:June 12, 2003
posts:164
votes: 0


amznVibe
Poor little gigablast.com is still under 200 million.

gigablast looks like a nice engine, any other like it.

The submit url issimple and no fuss the way I like it =)

This 49 message thread spans 2 pages: 49
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members