Forum Moderators: open

Message Too Old, No Replies

Is Freshbot now Deepbot?

The line is getting drawn ever thinner

         

trillianjedi

4:18 pm on May 22, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I've seen several postings about this now in the last few days, although this is my first actual experience of it.

I'm being hit very hard by google's freshbot at the moment, and going deep too. At first glance at what is currently going on with the little guys, I had to check and double check that the IP's were 64.... (they are).

It's behaviour, in terms of hard hitting and depth of crawl (it's going through the entire site) is more like the character of the old deepbot.

In fact, it's identical behaviour to deepbot the last time it crawled this site back in April.

I'm interested in hearing from others who are seeing the same.

TJ

jojojo

6:14 am on Jun 6, 2003 (gmt 0)

10+ Year Member



I added pages and pages of fresh content 3 days ago - it is all showing up in the SERPS now so freshbot is definitely crawling.

mack

6:19 am on Jun 6, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



I have noticed a few new pages getting in, But they aren't being dated the way fresh listings used to be. Don't know if this is something for the future or just a temporery glitch.

Mack.

berli

7:35 am on Jun 6, 2003 (gmt 0)

10+ Year Member



Freshie's in my logs too -- and still asking for pages I moved months ago. Obviously the lessons of April were not learned.

301
301
301

anallawalla

9:33 am on Jun 6, 2003 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Had freshbot 7 times since 1 June on a PR6 site (has a PR7 deeper) and 4 times on another PR6 site. There was a gap of 1-2 weeks since the previous visit.

- Ash

FleaPit

4:03 pm on Jun 6, 2003 (gmt 0)

10+ Year Member



Freshie has been hitting one of my sites for a few months now. I put up some new pages a few weeks back but it seems he just doesn't want to take a look! On my other sites freshie is always eager for a new tipple and dives straight into the the new content pages. Anyone else notice this? The links are right there but he just doesn't want to know, instead he keeps sniffing out the old pages but there is nothing really going on there!

Any ideas?

skipfactor

4:13 pm on Jun 6, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



No problem getting new stuff here. Do you have links to these new pages on your strongest PR page?

FleaPit

4:54 pm on Jun 6, 2003 (gmt 0)

10+ Year Member



Yeah on my idex page PR5, same as other sites. Can't understand it but something is causing freshie to turn his nose up!

Clark

7:29 pm on Jun 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Freshbot keeps hitting the same pages again and again. I know we won't know until GG decides to inform us or the event is upon us when a real crawl will come again, but I was wondering if any new sites are getting fresh pages crawled...or is G stale for new sites as well?

IITian

7:34 pm on Jun 9, 2003 (gmt 0)

10+ Year Member



I created about a dozen new pages yesterday night and today morning and freshbot came about 5 minutes later and picked up all of them. ;)

Clark

7:41 pm on Jun 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I had a 150 pages crawled in the last day or so but I think there's not a new one in the bunch. Oh well.

IITian

7:48 pm on Jun 9, 2003 (gmt 0)

10+ Year Member



I think it is feeling guilty in my case since its elder sister (brother?) lost all except the index page it crawled during April. Trying to make up for that, perhaps.

berli

9:05 pm on Jun 9, 2003 (gmt 0)

10+ Year Member



My site is about PR1 (the best in my cat are PR3, and several years older than mine, so I'm not worried) so freshbot doesn't come by to get my new pages (kinda sucks). But the freshie-as-deepbot has been slowing crawling my site this month, and it keeps asking for pages that were 301-redirected several months ago.

I know it's already been established that Googlebot doesn't seem to "know" about the April deepcrawl, yada yada. I'm just one more confirmation.

It is frustrating, though.

Clark

9:18 pm on Jun 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yeah. We may have to wait what, another 4 weeks or so? Plenty of time to work on more food for "G". I know I've got lots of food waiting :)

WebGuerrilla

9:30 pm on Jun 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>>i'm seeing freshbot daily

But are you seeing the pages the FB grabs show up in the index? From what I'm seeing, the FB system is only funtioning properly for those pages coming from sites that were already in the Feb/March db.

On new sites, FB is crawling regularly, but those new pages aren't showing up.

markus007

9:34 pm on Jun 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



yes i'm getting hundreds of pages crawled nearly every day and only my homepage is being updated in the index.
This 211 message thread spans 15 pages: 211