Forum Moderators: open

Message Too Old, No Replies

Google crawl truisms...

would you say these statements fly?

         

deft_spyder

10:02 pm on Dec 22, 2002 (gmt 0)

10+ Year Member



1. Any site with a pagerank has been spidered, and will probably be spidered with each deep crawl. If not always, the % chance of being deep crawled and thus updated is high.

2. If you have a link to another site on your index page, and your site has been spidered, that link will probably be followed at the next crawl, thus getting the other site spidered (and an incoming link).

3. Incoming links discovered that particular crawl are included in that deep crawl, not the next one, thus possibly effecting your PR immediately.

4. Search engines favor pages that have new content on them since the last update/indexing.

I mention #4 because there has been some talk about giving the googlebot a notice that the last changed file date is before the last crawl, and thus doesnt need to be indexed. I would think this is a sign of your site becoming stale, and treated accordingly.

jackofalltrades

10:11 pm on Dec 22, 2002 (gmt 0)



I would agree with all, but im not sure what you mean by number 2.

Yes, a link on your page will be followed and crawled, but how does that result in an incoming link?

Or have i mistaken your statment?

JOAT :)

jimbeetle

10:31 pm on Dec 22, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



JOAT, sounds like #2 refers to reciprocal links with a?new? site, the spider following the link from site1 to site2 then the link back to site1. Is that what you mean deft_spyder?

Jim

deft_spyder

10:59 pm on Dec 22, 2002 (gmt 0)

10+ Year Member



by #2 i mean that the link will be followed, and duly noted as an incoming link for the site that you linked.

I have an instance with a client where my page that links to him has been cached, but those links do not come up in googles list of incoming/backwards links when I examine his page.

HarryM

1:47 am on Dec 23, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



"4. Search engines favor pages that have new content on them since the last update/indexing"

Is there any evidence that this is true?

I am interested in this because I have lots of information pages on my site that are never going to change.

vitaplease

3:16 am on Dec 23, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



"4. Search engines favor pages that have new content on them since the last update/indexing"
Is there any evidence that this is true?

If you mean by "favor" rank higher, I would say there is no evidence.

There might be more frequent spidering though.

Check these thoughts: [webmasterworld.com...]