homepage Welcome to WebmasterWorld Guest from 54.243.17.133
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

This 102 message thread spans 4 pages: 102 ( [1] 2 3 4 > >     
Googlebot is back!
It looks like the deep crawl is starting.
RoadRash




msg:134915
 9:28 am on Mar 9, 2003 (gmt 0)

Google started to deep crawl my site in the last 15 minutes. Anyone else notice this?

 

ga_ga




msg:134916
 9:35 am on Mar 9, 2003 (gmt 0)

Yes I'm being invaded too. It's the freshbot here though, on 2 sites. Very hungry, must have had nothing to eat for a few days..

Crawler 11 on 64.68.82.xx

percentages




msg:134917
 9:43 am on Mar 9, 2003 (gmt 0)

I haven't seen the deep crawl bot yet, but to start crawling this fast (within 60 hours of the last update) is a complete nonsense.

Altavista....refreshed within 48 hours, Google.....Refreshed within the last 6 weeks if you are lucky!

Let's start a thread about the next update...sometime in April if Google can recalculate its PR that early.

Google if you can't calculate PR faster than every 6 weeks, stop putting so much importance on something that is way out of date.

EliteWeb




msg:134918
 10:20 am on Mar 9, 2003 (gmt 0)

I was just thinking what is being talked about here, I haven't seen googlebot to my site in a few days then I look at my network connectivity logs and see tons of googlebots and netscape looking bots connected to it non-stop so guess what, he's bacckkkkkkkkkkkkkkkkkkk.

adsoft13




msg:134919
 10:55 am on Mar 9, 2003 (gmt 0)

At my place I still saw old results on www 2 hours ago ...
So the update is probably not finished yet :)
But I don't see googlebot an ony of my sites ...

NickH




msg:134920
 11:46 am on Mar 9, 2003 (gmt 0)

Freshbot was at my site on Friday, took a break on Saturday, and is back today. No sign of the deepcrawler yet.

netguy




msg:134921
 11:51 am on Mar 9, 2003 (gmt 0)
Googlebot/2.1 ( http://www.googlebot.com/bot.html) stopped by this morning. No breakdown of whether its 216* or 64*... Is this FreshBot?
steveb




msg:134922
 1:35 pm on Mar 9, 2003 (gmt 0)

I've been crawled every day for weeks. The old truism that Freshbot disappears during the update is false.

AthlonInside




msg:134923
 2:08 pm on Mar 9, 2003 (gmt 0)

> Very hungry, must have had nothing to eat for a few days..

LOL! same here! :)

europeforvisitors




msg:134924
 3:22 pm on Mar 9, 2003 (gmt 0)

Google if you can't calculate PR faster than every 6 weeks, stop putting so much importance on something that is way out of date.

PR is only one of many factors that Google uses in determining search placement, so there's no need for it to be recalculated in real time. Don't confuse the desires of Webmasters with the needs of users. :-)

rfgdxm1




msg:134925
 3:56 pm on Mar 9, 2003 (gmt 0)

>PR is only one of many factors that Google uses in determining search placement, so there's no need for it to be recalculated in real time. Don't confuse the desires of Webmasters with the needs of users. :-)

Right. For the average searcher, if Google is using a 6 week old database this isn't a real problem.

netguy




msg:134926
 4:02 pm on Mar 9, 2003 (gmt 0)

I'm still not completely clear on how much influence FreshBot has with Deep Crawl when it comes to generating the index every month - But I do know that Freshbot is in there almost every day updating our news sites and making it available to the world Looong before the index is completed.

Buckley




msg:134927
 5:10 pm on Mar 9, 2003 (gmt 0)

Net Guy or anyone, does that mean if you get visits from freshbot, and you made changes to your title tag, you wouldn't have to wait for the next update to see the changes?

Can your position in the serps move based on this or do you have to wait for the dance to see any movement.

Thanks.

joeuz




msg:134928
 5:25 pm on Mar 9, 2003 (gmt 0)

Buckley, I have experienced this recently. I was changing a page and noticed that the changes were reflected in Google twice in 1 week.

RoadRash




msg:134929
 10:29 pm on Mar 9, 2003 (gmt 0)

Must have been the freshbot... I see ~50 or so new pages in the index today, just hrs after the crawl. I am expecting some 20,000 dynamic pages to be indexed in the next deep crawl. I have my fingers crossed.

PFOnline




msg:134930
 10:35 pm on Mar 9, 2003 (gmt 0)

Hi, sorry for newbie question! But, how exactly do we see if Googlebot is at our site?

Jesse_Smith




msg:134931
 6:02 pm on Mar 10, 2003 (gmt 0)

freshBot: 64.68.82.* bah, listed for only a few days, short dinner date then it dumps you.
deepcrawler: 216.239.46.* Good bot, it likes you, listed until death do you depart. So don't make him mad or it will divorce your site. You can divorce the Googlebot by using your robot.txt file. It's much cheaper and faster than going to the courts.

jdMorgan




msg:134932
 6:38 pm on Mar 10, 2003 (gmt 0)

Buckley,

Yes to both questions. Our fearless WebmasterWorld leader calls this "surfing the fresh wave."

Jim

peterdaly




msg:134933
 7:03 pm on Mar 10, 2003 (gmt 0)

Over 3000 hits from GoogleBot so far today.

They are all Freshbot. No need to get alarmed yet about the deep crawl. Not based on information from my server at least.

-Pete

bobmark




msg:134934
 7:17 pm on Mar 10, 2003 (gmt 0)

I'm wondering if there is a change underway.
I don't know if it is just a change in how Google handles my site or something more.
In the past, freshbot would take my index and main directory pages but nothing else. The past 2 days it is deep crawling the entire site.
Is this a pattern others have experienced in previous months or is it possible that 64.bot is doing 239.bot's work this month?
Ideas?

oLeon




msg:134935
 8:44 pm on Mar 10, 2003 (gmt 0)

now and then the freshbot crawled very deep on our sites.
some other days it only has a look at the homepage, or some more.

in this moment the freshbot is on his way around, I cannot see the deepbot at all.

4serendipity




msg:134936
 3:59 am on Mar 11, 2003 (gmt 0)

I got hit by freshbot on the 8th and 9th.

Deepbot started showing around 6 EST today.

WebMistress




msg:134937
 4:13 am on Mar 11, 2003 (gmt 0)

Google is deep crawling my PR6 site right now...*216...didn't wait long after the update, eh? and I'm not ready for him..of course, I never am no matter how much I optimize all month....I always need mre time...yikes!

joker197cinque




msg:134938
 11:08 am on Mar 11, 2003 (gmt 0)

Yes....my servers noticed DeepBot 216* 2 times(one at 1 am and one at 4 am italian time )

not ready at all.. :\

bobmark




msg:134939
 3:50 pm on Mar 11, 2003 (gmt 0)

yeah, I see deepbot now too. Guess I was wrong.
Am I the only one who thinks that, given how late this update was and how late the crawl is we might not see the "March" Update (assuming we define the current update as the "February Update" as the previous was Januiary) until mid to late April? In other words maybe this is gonna be the rare 6-7 weeks between updates that happens once a year or so.
Otherwise, Google will have to be re-indexing on crawl results from March 10 to March 15(?) within 2 weeks or so (yeah, I know they have done that too occasionally - I think August was like that if I recall right).

bluecorr




msg:134940
 4:55 pm on Mar 11, 2003 (gmt 0)

I just changed some pages and put them up. Googlebot deepcrawled some of the pages on the site prior to my latest update and will obviously come back to take the rest. Will it notice that the pages it had cralwed before are now fresher and if it does will it crawl them again?

Thanks

bether2




msg:134941
 4:56 pm on Mar 11, 2003 (gmt 0)

Freshbot is busy on my site (PR6). Deepbot (216.239.*) has been "knocking" - ie, hit about 15 pages last night and this morning. That usually means it will start its full-scale deep crawl sometime today or tonight.

Deepbot is usually very polite and knocks first. :) Gives me a little extra time to get those last-minute fixes done.

GoogleGuy




msg:134942
 5:42 pm on Mar 11, 2003 (gmt 0)

Hope everyone has been getting any new content up. :)

PaulPaul




msg:134943
 5:52 pm on Mar 11, 2003 (gmt 0)

Not at my site yet. :(

bobmark




msg:134944
 6:25 pm on Mar 11, 2003 (gmt 0)

I believe its been said on other threads but I wanted to say how much I appreciated both the update and deepcrawl headsup, GoogleGuy. Its nice to retain that feeling that we're all in this together.
For myself, I've been working on the assumption that it may be longer than average before the next update; if not, I'll be pleasantly surprised, if so I'll know I did everything possible to get my appropriate season pages in.

This 102 message thread spans 4 pages: 102 ( [1] 2 3 4 > >
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved