Forum Moderators: open

Message Too Old, No Replies

why one site crawled all the month and other stopped at 5 Sep?

         

deem0N

9:41 am on Sep 24, 2002 (gmt 0)

10+ Year Member



Hi all.

I have two sites.

<snip>
On the beginning of September I changed URL structure for both.
The goal was to reduce number of / in URL as I thought that it
was a problem. I.e. Google never visited product pages.

EX was crawled heavily each day all the month and I see new pages on www3 cached at 23 of September.

but for FS it is different: I see Google stopped crawling at 5 of Sep.
no changes at www3/www2.

look at
<snip> for FS Google logs
it ate NEW URL structure.... but stopped.

I am afraid that Google banned FS for some reason.

Any idea?

Thanks.

[edited by: engine at 10:04 am (utc) on Sep. 24, 2002]
[edit reason] no urls please [/edit]

warmasol

10:23 am on Sep 24, 2002 (gmt 0)

10+ Year Member



I don't think that Google banned that site. At 5th of September Google finished his monthly big crawl. After that Google crawled every day special pages he like. This are pages with a high PR or linked from pages with high PR. I think Google wiil crawl your site again with next big crawl.

GetVisible

11:01 am on Sep 24, 2002 (gmt 0)

10+ Year Member



.... or frequently change the content

deem0N

11:53 am on Sep 24, 2002 (gmt 0)

10+ Year Member



isn't fact that I changed link structure means that all pages are new
and becomes interesting for Google.

Note: EX site is crawled as crazy the whole month.