Finally I decided to ask you about the internals/mysteries of google, because after reading most of the relevant posts on this forum and taking the apropriate measures, still there are no (visible) results.
I have a site :-) <snip>. For about a year now, we tried to get indexed by Google, but no luck so far. The site is written with PHP, and is hosted on a virtual server (with it's own IP, etc.)
Google would index only the top pages from the main site, without following the links. However, for the forum (based on phpBB), it would index most of the pages.
Recently, I've employed mod_rewrite for the purpose of presenting the URLs as plain html.
A few days ago, we received a visit from the Scooter/3.2 (Altavista), which successfully crawled about 80.000 pages on the site. This was follwed by Google, which crawled about 9 (from IPs at 216.239.46.xxx) and about 32 from IPs at 64.68.82.xxx.
The latest visits daily.
Could anyone please give me a hint so as to why GoogleBot doesn't like to follow the links as other search engines did? (moreover that now they look like plain html, etc). What piece of the big picture am I missing here?
[edited by: Marcia at 9:46 am (utc) on Nov. 15, 2002]
[edit reason] url removed [/edit]