Forum Moderators: martinibuster
Anyone know of any ad programs that use Inktomi?
Seriously though, I have gotten 700 visits from Inktomi since it went like on Yahoo, and about 30 from Google in the llast month.
Why is it that Inktomi can crawl dynamic content in the form of [example.com...] yet not only can Googlebot not crawl those pages, but it can't even display ads on those pages.
That is not true. It is a Google myth. Google indexes dynamic pages but probably at a slower pace. AFAIK, it still indexes all dynamic pages unlike a popular belief.
I suspect it depends on how long your server takes to serve a crawled page. If it takes longer, Google seems to wait longer to crawl next page. I suggest that you use caching techniques.
If you use PHP, I suggest that you use the Turck MMCache extension [turck-mmcache.sourceforge.net]. It can compile, optimize and cache PHP scripts. Despite it is free, it is claimed to be the fastest available.
If your content is database driven I strongly encourage you to avoid database accesses as much as you can. What you can do is to store in disk files whole pages or just excerpts of pages that built from data taken from the database. Once you cache these pages or excerpts, you will not need to access the database and over again. Page delivery becomes much faster.
The Turck MMCache extension also caches content of pages or excerpts in shared memory. I just do not use that feature of MMCache because in the site that I use it I have more than 6000 excerpts being cached at the same time. Caching all in shared memory would blow my server shared memory limits.
Instead I use this class for caching arbitrary data in disk files [phpclasses.org]. It is very robust as it uses safe locking to prevent simultaneous accesses to overwrite the cache files, which would be a problem especially on busy sites.
Seriously though, I have gotten 700 visits from Inktomi since it went like on Yahoo, and about 30 from Google in the llast month.
Google may not be indexing all your pages as you expected if you employ things that understood by Google as cloaking, things that make the users see pages differently than the search engine. Your pages may be black listed if that is the case.
Make sure you are not embedding session ids in links or using Javascript events, such as onclick any links of your pages.
