homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

deepcrawl is still crawling
will it affect feb results?

 4:59 pm on Feb 16, 2003 (gmt 0)

hi there guys,
just yesterday, the deepcrawl bot visited my site with a lot of hits...i am just wondering if these hits would affect the new update which google will do by the end of feb..



 6:12 pm on Feb 16, 2003 (gmt 0)

As far as I know they should.

Are you sure it is the deepcrawler? (ip starts with 216.)


 6:35 pm on Feb 16, 2003 (gmt 0)

yes...it is deepcrawl..216...with 6 different ip's...
like 216.xxxxxxxx ...and 6 diff ones..
one more quick q...is this a good sign?...i mean i want my pages to be be indexed asap..


 6:58 pm on Feb 16, 2003 (gmt 0)

Deepcrawl is really crawling, had it on my site, too.
Right now, exactly: 19:45:21


 7:01 pm on Feb 16, 2003 (gmt 0)

is it good that deepcrawl is crawling now..and i should assume that the crawled results would show in feb update?

troels nybo nielsen

 7:12 pm on Feb 16, 2003 (gmt 0)

It ought to be a good sign, but you cannot be sure. You'll have to be patient till the update has finished, most likely in the beginning of next month.

Have you been deepcrawled earlier this month?


 7:30 pm on Feb 16, 2003 (gmt 0)

Argg. I was hoping it had stopped as I'm in the middle of moving servers and have new IP's etc.


 7:37 pm on Feb 16, 2003 (gmt 0)

yeah i was deepcrawled earlier as well..and again yesterday..


 8:11 pm on Feb 16, 2003 (gmt 0)

I hope it is still crawling because I haven't been visited at all yet. I am listed in the dmoz directory and the page i am listed on hasn't been recached yet so I assume it hasn't got that far yet, I hope so anyway.

Could anyone verify this?


 8:17 pm on Feb 16, 2003 (gmt 0)

no crawler here except for freshbots

troels nybo nielsen

 8:29 pm on Feb 16, 2003 (gmt 0)

Welcome to WebmasterWorld, maxpower.

I would be very cautious with interpretations of Google's caches not being changed. It often happens that pages have old caches for a long time.

My guess FWIW would be that those pages have a good chance of getting into the index with their recent changes at the next update. It might depend on how established your site is and how high PR those pages have got.


 8:41 pm on Feb 16, 2003 (gmt 0)

I recently revamped my whole site, in fact about 4 weeks ago, cached version of old site is still up, will it change after this months deepcrawl, at what stage? Early March?


 8:42 pm on Feb 16, 2003 (gmt 0)

Actually I just realised that the tracker I'm using (extreme tracker) doesn't record googlebot visits. I looked on my control panel and I have 6 hits from googlebot 2.1, so hopefully all is well.

Does google update it's cache before the dance normally?

troels nybo nielsen

 8:48 pm on Feb 16, 2003 (gmt 0)

Welcome to WebmasterWrold, Jammy_James

Some of my pages still have caches from november. I must admit knowing very little about the "normal" behaviour of Google's caches. I have never been very interested in them, and now I am using noarchive tags to avoid having my pages cached.


 8:56 pm on Feb 16, 2003 (gmt 0)

Forgive me if this is a dumb question. If google cannot archive your page, how will it know what keywords to show your page under?
Or does 'no-archive' simply mean it stores the page contents but doesn't make a cached version publicly available?

troels nybo nielsen

 9:13 pm on Feb 16, 2003 (gmt 0)

maxpower, it is certainly not dumb admitting your ignorance. And it is quite alright being ignorant about webmastering. That is if you're not a hardcore professional being paid by people who believe that you know a lot about it.

The idea of having a noarchive tag is to relieve Google of the moral burden of offending my copyrights by publishing the cache. ;)

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved