Forum Moderators: open

Message Too Old, No Replies

Site dropped but...

Googlebot came crawling all month

         

hutchins13

5:55 pm on Sep 29, 2002 (gmt 0)

10+ Year Member



I have a site that was dropped from the new index, except for one internal page. All pages now have a greyed out pagerank except for the one page still in the index which has a 0 pagerank. When I do a allinurl search for the site in Google, the one internal page comes up but without a page title or description... just the page URL.

To me, this looks like the site was dropped, not penalizes. The weird thing is that Googlebot came grabbing pages just about every day between the last update and the previous update.

Has this happened to anyone else? Is there a good chance of being back on the index next month?

jdMorgan

6:31 pm on Sep 29, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



hutchins13,

Is this a new site, i.e. less than two months old?

Many new sites get picked up mid-cycle and are added to the index. Then they seem to pop in and out until the next index is published (It seems like the mid-cycle additions are kept in an off-to-the-side "new stuff" database which is handled in some special way to combine it with the real index). Some of these new sites drop out completely when the new index is published.

However, those sites which report continued Googlebot crawling activity after this happens often show up "permanently" after the next full indexing cycle.

Every month we see lots of "I was in, now I'm out" postings here from panicked owners of new sites, and it seems to follow this pattern.

My conclusion is that it basically takes two full crawl cycles before a site is really "in".

Jim

hutchins13

6:46 pm on Sep 29, 2002 (gmt 0)

10+ Year Member



No... this is a site that has been in Google since about April of 2001. Until this last update, everything was great. That's why it seems so weird to me.

jdMorgan

6:52 pm on Sep 29, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Very strange...

What is different about the page that "survived" in the index? Strong incoming external links?

Any chance your server went down while the 'bot was visiting?

Jim

hutchins13

3:38 am on Sep 30, 2002 (gmt 0)

10+ Year Member



There is nothing different about this page... just a product category page for an ecom site... no external links to this page. Googlebot was grabbing pages just about every day between the last two updates.

There is one bright point... traffic this weekend vs. last weekend is down 60%, but number of orders is only down 17% (sales dollars are down only 8%!). I guess it's true that Google produces a lot of traffic, but the conversion rate just doesn't compare to traffic from other sources.

hutchins13

3:45 pm on Sep 30, 2002 (gmt 0)

10+ Year Member



I think it was on Saturday that I used the manual URL submission, hoping that maybe this would help. Well, today I have 36 pages back on the index. They all have a freshness tag of Sunday the 29th. Maybe Google is seeing this site now as a new site and is adding pages prior the next regular update. If so, they will probably fall out like other people have reported with new sites, but some pages are back, so maybe the month won't be as bad as previously expected. I have my fingers crossed!