homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

This 41 message thread spans 2 pages: < < 41 ( 1 [2]     
Google is exposing its weakness
Someone will make a lot of money because of this

 10:02 pm on Mar 3, 2003 (gmt 0)

Well, it's been almost 6 weeks since google's last update. Even with freshbot and everflux how relavent are the listings - their old, plain and simple. Google's weakness is it's slow update schedule - freshbot never really indexes anything but a home page - it's searchs therefore are never truly accurate. Hell, I've added several pages to my site that googlebot's been to but fresh hasn't touched - how can google claim it has the most relavent searches then.

If another company could develop a search engine that provided relative results with a much faster update they'd end up ruling the search engine world.

I think it's time I got into the search engine business!

Google - I'm comming for ya! Run!



 3:51 am on Mar 4, 2003 (gmt 0)

I waiting for (besides the update) another rabbit to come out of their hat. Like BPR (blog page rank) which is calculated as blogs add links, the pr is instantly applied.

In the meantime i got my latest page index by inktomi for free and i'm getting hits from msn based on a SERP spot of 9 (i did not even optimize for ink yet :) ) [and a number of other spots, page works with alot of different search phases] and i' am not yet listed in google [believe it or not]. I'm starting to have nice feelings about Ink.


 3:56 am on Mar 4, 2003 (gmt 0)

Without piles of cash, itīs hard to beat Google at what they do now (indexing the whole web), but...

...what if somebody creates an engine restricted to certain topics? E.g., a technology SE, or a medicine SE, or a sports SE. They could use the same seeds as google to start the crawling (the appropriate dmoz cats, some highly recognized sites, etc), apply whatever google developed and is not patented (something similar to pagerank), and add something else, not feasible to google, but feasible to smaller databases (I have no idea what this something else could be, but for sure I am not the smartest person in the world).

Then, google would face some fiercer competition (I donīt know why, but I am thinking about Googleguy pretending to be Maxwell Smart and saying: "yeah, I gonna love it" - or however he says that in English )


 4:36 am on Mar 4, 2003 (gmt 0)

If Inktomi were to throw a search on it's site, do you think it's popularity would soar? Or is there some fatal flaw with it - as to why it's used as a back up only for other searches? How does it's search comapre to google?

If google and inktomi where to go head to head who would win?


 5:29 am on Mar 4, 2003 (gmt 0)

>freshbot never really indexes anything but a home page

That's just flat earth nonsense.

Freshbot takes (probably) all my pages every month, multiple times a month. I'm could test multiple word queries on minor interior pages on my site just about every week.

If you don't know how to attract freshbot, or how to help it once it comes, that is a different issue, but saying the world is flat isn't goint to help you.


 5:37 am on Mar 4, 2003 (gmt 0)

Is steveb correct?

Are there other people getting over 50-100 pages indexed by the freshbot?

This is not indicitive of current Google SE results. Actually at this point, the results are getting so stale that alot of the results in that I click on return a 404 error.

askjoe, has a point about the results being stale after 4-6 weeks. Yet, others have a point in that, it is an extreamly difficult task to spider the entire web gathering, organizing, computing, and return SEO results all in 4-6 weeks...


 5:46 am on Mar 4, 2003 (gmt 0)

Freshbot has hit 400+ of my pages in march, and it looks like around 10-20% of my pages are showing dates.


 6:09 am on Mar 4, 2003 (gmt 0)


Agree with steveb. Its nonsense to say freshbot only updates home pages based on a small sampling, (maybe own pages). almost all if not all, our new pages are freshindexed daily.

freshbot hits 120 pages on one of our sites daily, (site has total of 2,500 hand-made pages and around 1,000 template drivern pages) with a few misses - maybe 2 or 3 days a month,

other smaller sites with around 200 to 500 pages get around 20 to 50 pages hit every day of freshbot.

All sites add new internal links around 5 to 25 days a month. Home/Index page PR is 6 on the smaller sites and 7 on the large site.

All NEW pages (not changed pages) linked from the freshbotted pages are indexed almost immediately after the fresh bot visit.

Hope this helps


 7:10 am on Mar 4, 2003 (gmt 0)

Well, it's been almost 6 weeks since google's last update. Even with freshbot and everflux how relavent are the listings - their old, plain and simple.

Looking at Google's cache of my pages that are crawled by freshbot shows a date of March 3, the other pages have a date of Jan 3.

Inktomi has a date of Feb 28 for the index page and dates of Feb 1 through the 6th for the other pages even though slurp visits my site daily. The site was crawled twice during the last month, and the index page was grabbed almost daily, up to 3 times a day, yet this isn't reflected in the results.

FAST has a date of March 2 for my index page and Feb. 10 through the 13th for the remainder of the pages. FAST grabs our index page daily and it shows in the results. Look at almost any average site and the index page is usually the only page refreshed by FAST. Some sites show pages with dates from the beginning of last November.

Google by far displays the largest amount of fresh pages.


 7:26 am on Mar 4, 2003 (gmt 0)

PaulPaul wrote:
>Are there other people getting over 50-100 pages indexed by >the freshbot?

Since early Sunday morning (when my log files rolled over),
the Freshbot has hit 71 out of 111 pages on my site, most
of them more than once. Some of the 111 are old pages
that I haven't deleted yet, although they aren't linked
from any other pages.


 7:40 am on Mar 4, 2003 (gmt 0)

Checking a few other sites, I think the descrepency lies in my little knowledge of the decision algorithm which chooses which site get heavily fresh crawled.

My Site has over 10k pages indexed, it is a PR5, and it is not heavily fresh crawled, about 3-7 pages per day. While testing other fairly common sites, I notice they also did not have many "fresh" listings, even ones that I know are heavily SEO'd. Conversly, when checking a national magazine, a PR8 site, I noticed many many "fresh" listings.

Guess my PR's not high enuf... :( Im hoping for a PR6 this month..


 7:44 am on Mar 4, 2003 (gmt 0)

Looking at jtbells comments seems like Im completely wrong...

But the thing is, looking for ski products that just have been hitting the market recently are currently non-existant in the current SERP.

I am waiting for the new update to check out the reviews / prices / comments on new ski equipment...

This 41 message thread spans 2 pages: < < 41 ( 1 [2]
Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved