Forum Moderators: open

Message Too Old, No Replies

Google still deepcrawling

strange cycle

         

HuhuFruFru

10:33 am on Feb 27, 2003 (gmt 0)

10+ Year Member



googlebot is still visiting my site, not very hard, but it is here - this month both the deepcrawl and freshbot were really strange, is there an explanation for this?

beachlover

10:45 am on Feb 27, 2003 (gmt 0)

10+ Year Member



Are you sure that it is the deepcrawler? Freshbot has been busy on our sites all night long - but no sight of the deepcrawler.

ibpotter

10:47 am on Feb 27, 2003 (gmt 0)

10+ Year Member



My Danish site gets Freshbot visits - but no deepcrawl the last three weeks.... Sure it is Deepcrawl?

HuhuFruFru

10:52 am on Feb 27, 2003 (gmt 0)

10+ Year Member



crawl24.googlebot.com - - [27/Feb/2003:11:03:23 +0100] "GET /xxx.html HTTP/1.0" 200 10969 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

beachlover

10:59 am on Feb 27, 2003 (gmt 0)

10+ Year Member



What is the IP of that bot? The Feshbot shows up in your logs as crawl##.googlebot.com, too.

See this [webmasterworld.com] thread.

pfritz

11:16 am on Feb 27, 2003 (gmt 0)

10+ Year Member



IP address of this bot is 64.39.29.158

It's a freshbot.

Deep crawl bot IP starts from 216...

HuhuFruFru

11:30 am on Feb 27, 2003 (gmt 0)

10+ Year Member



but someone once said that "crawl" means deepcrawl and "crawlER" freshbot

how can i find out the IP? i can only see "crawl24" in my logfile.

beachlover

11:36 am on Feb 27, 2003 (gmt 0)

10+ Year Member



You should check your raw logfiles. They include the IPs of the various bots.

kwngian

11:40 am on Feb 27, 2003 (gmt 0)

10+ Year Member




Lucky peoples to have freshbot still visiting you.

I get neither for my new pages created, only some surfer at google using ip address of 216.239.45.4 using W2K with Hotbar browser extn surfing my site. Its getting me kind of worried.

kwngian

theleveller

12:52 pm on Feb 27, 2003 (gmt 0)

10+ Year Member



Yup still getting crawled, got a little worried yesterday as everyone was reporting fresh bot's and nothing for me..

I think we should all sit back and relax as google have obviously earmarked the update for next July :)

curlykarl

1:06 pm on Feb 27, 2003 (gmt 0)

10+ Year Member



"I think we should all sit back and relax as google have obviously earmarked the update for next July"

Why obviously? :)

theleveller

1:37 pm on Feb 27, 2003 (gmt 0)

10+ Year Member



I wonder if William Hill or some other betting place would take bets on wether or not the update starts this weekend.. any idea on the odds?

Could make a packet... come on googleguy give us some insider trading..

skipfactor

2:43 pm on Feb 27, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



"I think we should all sit back and relax as google have obviously earmarked the update for next July"

Right on. This is my first potential indexing after 2 months of trying & I'm sick & tired of it.

Google's the monopoly God right now, and they're the best when it's all indexed & FINALLY done, but their weakness is their cycle time. I know, it can't be done any faster at the moment, but I for one would like to see a few competitors somehow exploit this weakness.

Like an article I read stated something like, "There may be a cure for cancer on the Web somewhere, but if it's a new Web site and you're using Google or Yahoo, it won't be discovered for 2 months!

studmuffin

3:01 pm on Feb 27, 2003 (gmt 0)

10+ Year Member



"There may be a cure for cancer on the Web somewhere, but if it's a new Web site and you're using Google or Yahoo, it won't be discovered for 2 months!"

Ummm... not true in my case. I launched a new site in October last year and within 10 days I was number 1 for my preferred search term in Google and Yahoo.

skipfactor

3:39 pm on Feb 27, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Ummm...very true w/ 3 of my always-been-honest 2 month-old domains, ALL w/ legit, relevant backlinking. Everybody else loves me. Maybe I should change my handle to studmuffin! :)