| 7:18 am on Nov 8, 2002 (gmt 0)|
>Google has added 6 hundred plus million pages to its index
I would not be suprised if this has happened gradualy over the last few updates.
| 7:28 am on Nov 8, 2002 (gmt 0)|
>>I would not be suprised if this has happened gradualy over the last few updates.
Let's just say over the last 6 months and you're still looking at one hundred million pages per month. How much competition is that? I have a new client that thinks 300 million of those pages were targeting his keywords and apparently they are all linked together. :) He swears his main competitor is PR 11.
The minty fresh bot seems to slog her way through all those pages just as quickly though. Must be invisible text... ;)
| 7:30 am on Nov 8, 2002 (gmt 0)|
Yes - I find it hard to believe they keep the same number of pages to the exact last digit for several updates.
I just don't know why they don't keep updating it every month - unless they don't want to take any small back steps and have people whining that their site was one of the 4,398 that were "removed" from the last update.
It would clear up 20% of the posts around that time of the month too - if they would keep the number of pages in tune with a new update.
| 7:20 am on Nov 15, 2002 (gmt 0)|
Finally I decided to ask you about the internals/mysteries of google, because after reading most of the relevant posts on this forum and taking the apropriate measures, still there are no (visible) results.
I have a site :-) <snip>. For about a year now, we tried to get indexed by Google, but no luck so far. The site is written with PHP, and is hosted on a virtual server (with it's own IP, etc.)
Google would index only the top pages from the main site, without following the links. However, for the forum (based on phpBB), it would index most of the pages.
Recently, I've employed mod_rewrite for the purpose of presenting the URLs as plain html.
A few days ago, we received a visit from the Scooter/3.2 (Altavista), which successfully crawled about 80.000 pages on the site. This was follwed by Google, which crawled about 9 (from IPs at 216.239.46.xxx) and about 32 from IPs at 64.68.82.xxx.
The latest visits daily.
Could anyone please give me a hint so as to why GoogleBot doesn't like to follow the links as other search engines did? (moreover that now they look like plain html, etc). What piece of the big picture am I missing here?
[edited by: Marcia at 9:46 am (utc) on Nov. 15, 2002]
[edit reason] url removed [/edit]
| 9:36 am on Nov 15, 2002 (gmt 0)|
thanks for your comments on my predicament earlier in the thread.
| 10:14 am on Nov 26, 2002 (gmt 0)|
:o My server reports show that Google has visited my site every day for the past month or so. :) I assume that this is the "FreshBot". Before that my site was visited on the 3rd of the month every three months :( and then every month after earning a PR4. :) The listing has displayed a date beside it some days. When I search for the domain name without the extension (ie:DomainName)I can find the "fresh" listing and the cache is current. :) I use a server side date call in the footer to keep track of the updates in the Google cache. When I search for the whole domain name (DomainName.ext) I get the listing/cache from the Oct 3rd visit. :(
My question is this: When,if ever,will the listing for the domain name be the same as the fresh listing?
|Made In Sheffield|
| 11:33 am on Nov 26, 2002 (gmt 0)|
I'm pretty new to this compared to some but my guess in answer to your question is never.
My site has been in Google thanks to minty for the last 3 weeks, if I do a search for my domain name it comes up with "no information".
I believe that the freshbot doesn't store it's data in the same index/part of the index that the site information/links information is stored in, the results you see are a combination of two different indexes so a search for your domain name will never bring up the data from the minty data.
Hope that makes sense :-)
| 12:32 pm on Nov 26, 2002 (gmt 0)|
That makes perfect sense, Made_In_Sheffield. It's much easier to study Google just after an update, before the Everflux kicks in to any major degree.
| 12:37 am on Nov 30, 2002 (gmt 0)|
you are right, it's just a strong assumption about the algo-shift not a fact. in seo you never really have a ceteris paribus situation so you won't be able to say something is 100%. anyhow in discussions many poeple express things as if they would be facts just because they are absolutely convinced of them. :)
one thing: the pages i could get into google by freshbot all survived the complete month and even another bunch of new pages that were published just a week ago are now showing up in www2/www3. i am wondering if this is an exception or if it will happen regularly...
| This 39 message thread spans 2 pages: < < 39 ( 1  ) |