Forum Moderators: open

Message Too Old, No Replies

Dynamic Crawl Depth

         

CodeXXX

5:03 pm on Jun 21, 2003 (gmt 0)

10+ Year Member



I was wondering how I can fool google into thinking my website is not dynamic but simply Flat html, because google will only crawl the links on my front page and wont go any deeper, already i use a mod_rewite to change "index.php?page=1" into just "/page/1" but google still knows its dynamic.

Gorilla

5:52 pm on Jun 21, 2003 (gmt 0)

10+ Year Member



Low PageRank will also stop Google from crawling your pages. Based on the information in your message this could be the reason you do not see Google crawling your internal pages. In my experience Fresh does not crawl pages below PageRank 3 or thereabout.

I don't think the crawl just in front of the latest update went as deep PageRank wise as previous deep crawls have done.

vincevincevince

5:53 pm on Jun 21, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



in your .htaccess put

AddType application/x-httpd-php .php .php3 .phtml .html .htm

then you can change all your .php to .htm

and then use mod_rewrite or a 404 trick to change file.php to file.htm via a 301 redirect for incoming links / stray internal links which still go to file.php.