How does Google read dynamic pages which are not linked from any other page.
These pages retrieve information from database, how is Google being able to cache them
Anyone pls let me know..
praveenk
volatilegx
2:14 pm on May 1, 2006 (gmt 0)
Google can find the pages if you have the Google toolbar installed and browse the pages. If you do not want Google to spider those pages, then disallow them in your robots.txt file, or use a <meta name="robots" content="noindex"> tag.
praveenk
4:05 pm on May 2, 2006 (gmt 0)
Thanks...
However there are pages from database in Google Cache...which are pretty new..I believe these pages were never searched for by anybody.
So if we believe Google is not finding pages from Google Toolbar then is there any method through which it can read dynamic pages..