Forum Moderators: open
If another company could develop a search engine that provided relative results with a much faster update they'd end up ruling the search engine world.
I think it's time I got into the search engine business!
Google - I'm comming for ya! Run!
In the meantime i got my latest page index by inktomi for free and i'm getting hits from msn based on a SERP spot of 9 (i did not even optimize for ink yet :) ) [and a number of other spots, page works with alot of different search phases] and i' am not yet listed in google [believe it or not]. I'm starting to have nice feelings about Ink.
...what if somebody creates an engine restricted to certain topics? E.g., a technology SE, or a medicine SE, or a sports SE. They could use the same seeds as google to start the crawling (the appropriate dmoz cats, some highly recognized sites, etc), apply whatever google developed and is not patented (something similar to pagerank), and add something else, not feasible to google, but feasible to smaller databases (I have no idea what this something else could be, but for sure I am not the smartest person in the world).
Then, google would face some fiercer competition (I donīt know why, but I am thinking about Googleguy pretending to be Maxwell Smart and saying: "yeah, I gonna love it" - or however he says that in English )
If google and inktomi where to go head to head who would win?
That's just flat earth nonsense.
Freshbot takes (probably) all my pages every month, multiple times a month. I'm could test multiple word queries on minor interior pages on my site just about every week.
If you don't know how to attract freshbot, or how to help it once it comes, that is a different issue, but saying the world is flat isn't goint to help you.
Are there other people getting over 50-100 pages indexed by the freshbot?
This is not indicitive of current Google SE results. Actually at this point, the results are getting so stale that alot of the results in that I click on return a 404 error.
askjoe, has a point about the results being stale after 4-6 weeks. Yet, others have a point in that, it is an extreamly difficult task to spider the entire web gathering, organizing, computing, and return SEO results all in 4-6 weeks...
Agree with steveb. Its nonsense to say freshbot only updates home pages based on a small sampling, (maybe own pages). almost all if not all, our new pages are freshindexed daily.
freshbot hits 120 pages on one of our sites daily, (site has total of 2,500 hand-made pages and around 1,000 template drivern pages) with a few misses - maybe 2 or 3 days a month,
other smaller sites with around 200 to 500 pages get around 20 to 50 pages hit every day of freshbot.
All sites add new internal links around 5 to 25 days a month. Home/Index page PR is 6 on the smaller sites and 7 on the large site.
All NEW pages (not changed pages) linked from the freshbotted pages are indexed almost immediately after the fresh bot visit.
Hope this helps
Well, it's been almost 6 weeks since google's last update. Even with freshbot and everflux how relavent are the listings - their old, plain and simple.
Looking at Google's cache of my pages that are crawled by freshbot shows a date of March 3, the other pages have a date of Jan 3.
Inktomi has a date of Feb 28 for the index page and dates of Feb 1 through the 6th for the other pages even though slurp visits my site daily. The site was crawled twice during the last month, and the index page was grabbed almost daily, up to 3 times a day, yet this isn't reflected in the results.
FAST has a date of March 2 for my index page and Feb. 10 through the 13th for the remainder of the pages. FAST grabs our index page daily and it shows in the results. Look at almost any average site and the index page is usually the only page refreshed by FAST. Some sites show pages with dates from the beginning of last November.
Google by far displays the largest amount of fresh pages.
Since early Sunday morning (when my log files rolled over),
the Freshbot has hit 71 out of 111 pages on my site, most
of them more than once. Some of the 111 are old pages
that I haven't deleted yet, although they aren't linked
from any other pages.
My Site has over 10k pages indexed, it is a PR5, and it is not heavily fresh crawled, about 3-7 pages per day. While testing other fairly common sites, I notice they also did not have many "fresh" listings, even ones that I know are heavily SEO'd. Conversly, when checking a national magazine, a PR8 site, I noticed many many "fresh" listings.
Guess my PR's not high enuf... :( Im hoping for a PR6 this month..
But the thing is, looking for ski products that just have been hitting the market recently are currently non-existant in the current SERP.
I am waiting for the new update to check out the reviews / prices / comments on new ski equipment...
