Welcome to WebmasterWorld Guest from 220.127.116.11
Forum Moderators: open
Let's just say over the last 6 months and you're still looking at one hundred million pages per month. How much competition is that? I have a new client that thinks 300 million of those pages were targeting his keywords and apparently they are all linked together. :) He swears his main competitor is PR 11.
The minty fresh bot seems to slog her way through all those pages just as quickly though. Must be invisible text... ;)
I just don't know why they don't keep updating it every month - unless they don't want to take any small back steps and have people whining that their site was one of the 4,398 that were "removed" from the last update.
It would clear up 20% of the posts around that time of the month too - if they would keep the number of pages in tune with a new update.
Finally I decided to ask you about the internals/mysteries of google, because after reading most of the relevant posts on this forum and taking the apropriate measures, still there are no (visible) results.
I have a site :-) <snip>. For about a year now, we tried to get indexed by Google, but no luck so far. The site is written with PHP, and is hosted on a virtual server (with it's own IP, etc.)
Google would index only the top pages from the main site, without following the links. However, for the forum (based on phpBB), it would index most of the pages.
Recently, I've employed mod_rewrite for the purpose of presenting the URLs as plain html.
A few days ago, we received a visit from the Scooter/3.2 (Altavista), which successfully crawled about 80.000 pages on the site. This was follwed by Google, which crawled about 9 (from IPs at 216.239.46.xxx) and about 32 from IPs at 64.68.82.xxx.
The latest visits daily.
Could anyone please give me a hint so as to why GoogleBot doesn't like to follow the links as other search engines did? (moreover that now they look like plain html, etc). What piece of the big picture am I missing here?
[edited by: Marcia at 9:46 am (utc) on Nov. 15, 2002]
[edit reason] url removed [/edit]
My question is this: When,if ever,will the listing for the domain name be the same as the fresh listing?
My site has been in Google thanks to minty for the last 3 weeks, if I do a search for my domain name it comes up with "no information".
I believe that the freshbot doesn't store it's data in the same index/part of the index that the site information/links information is stored in, the results you see are a combination of two different indexes so a search for your domain name will never bring up the data from the minty data.
Hope that makes sense :-)
you are right, it's just a strong assumption about the algo-shift not a fact. in seo you never really have a ceteris paribus situation so you won't be able to say something is 100%. anyhow in discussions many poeple express things as if they would be facts just because they are absolutely convinced of them. :)
one thing: the pages i could get into google by freshbot all survived the complete month and even another bunch of new pages that were published just a week ago are now showing up in www2/www3. i am wondering if this is an exception or if it will happen regularly...