Forum Moderators: open

Message Too Old, No Replies

Google Deep Crawl Question - Shallow then Deep?

How does the crawler work?

         

instabill

8:58 pm on Jan 4, 2003 (gmt 0)

10+ Year Member



Googlebot hit my site today. PageRank 4 site. It only looked at pages that were accessable from the home page but did see my site map. Does the crawler do an initial scan of the site and then come back go deeper? It was the 216 bot... :)

Brett_Tabke

2:00 pm on Jan 6, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Right. If this is a fresh site, then right. Get more links dude, don't let it ignore you. pr value of the site/pages directly affect how often gbot visits and how deep it goes inbetween major updates.