Welcome to WebmasterWorld Guest from 18.205.109.82

Forum Moderators: open

Message Too Old, No Replies

Is Freshbot now Deepbot?

The line is getting drawn ever thinner

     
4:18 pm on May 22, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member trillianjedi is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 15, 2003
posts:7256
votes: 3


I've seen several postings about this now in the last few days, although this is my first actual experience of it.

I'm being hit very hard by google's freshbot at the moment, and going deep too. At first glance at what is currently going on with the little guys, I had to check and double check that the IP's were 64.... (they are).

It's behaviour, in terms of hard hitting and depth of crawl (it's going through the entire site) is more like the character of the old deepbot.

In fact, it's identical behaviour to deepbot the last time it crawled this site back in April.

I'm interested in hearing from others who are seeing the same.

TJ

4:31 pm on June 3, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member annej is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Feb 17, 2002
posts:3318
votes: 0


I think they just haven't been showing the fresh dates in the serps. I haven't seen any lately yet the cache on a page I've updated is now showing the update.
2:53 pm on June 3, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 23, 2003
posts:50
votes: 0


My site, despite fresh content, hasn't been boosted in the SERPS for about 2 weeks. My cached pages are two weeks old. In the past, when I have played with content, I have seen the new results in about 24 hours. Is anyone else seeing sluggish freshbot results? Or less frequent updates to their cached pages?

Also, I have access to my visitor IP Addresses(through my webstat program). Is this the correct place to look for freshbot/deepbot addresses? I do not have access to my raw server logs.

Thanks.

3:20 pm on June 3, 2003 (gmt 0)

Preferred Member

joined:May 28, 2002
posts:377
votes: 0


Freshbot normally for my site is every 2-3 days. The last fresh listing I have was in May 27-28. I have been expecting it this June 1st or so but have not seen it.

On the other hand, deepbot is currently busy, since Sunday and up to this morning it has been to my site 678 times already. So we'll see if this is the new deep crawl.

Cheers

5:48 pm on June 3, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 7, 2003
posts:167
votes: 0


Freshbot is around. Don't be alarmed. My site was not freshbotted for a week or so then it returned. Sometimes if there's a glitch on getting to your site for some reasons (maybe the internet is slow etc) then it seems to skip your site that run.

Just one of those things.

5:54 pm on June 3, 2003 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lorax is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Mar 31, 2002
posts:7577
votes: 4


It's been to one of my sites almost daily and visits another one every few days though it seems to really like the robots.txt file more than the content as of late. LOL.
6:02 pm on June 3, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 7, 2003
posts:167
votes: 0


Leave out google-bait (fresh content)
6:23 pm on June 3, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Mar 20, 2003
posts:390
votes: 0


I had a bunch of new pages crawled on Friday/Saturday and I've been expecting them to show up in the index, but so far no dice.
8:56 pm on June 3, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 4, 2002
posts:1687
votes: 0


I've had freshie update the main page, PR6, recently, but the new pages it's found aren't making it into the datacentres.

If I could stray off topic...
My hosting company had my site down for 19 hours, yesterday to today. I'm in the process of changing companies because of it having happened too many times. Does anyone know if this will deter freshie from coming back if the site was down when it visited? (Freshbot has been dropping by regularly the last week or so).

10:08 pm on June 3, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Oct 8, 2001
posts:2882
votes: 0


Stefan, glad that freshbot found you. :)
6:19 am on June 4, 2003 (gmt 0)

Preferred Member

joined:Oct 23, 2002
posts:449
votes: 0


One of our main sites benefitted greatly from Freshbot, Ive got page 1 rankings across the board for very relative content and it's held steady for several days now. Odd thing is though is that they are new static pages on a well established PR7 site that are still greyed out yet still beating out PR5 and in some cases even beating out Yahoo.

EquityMind

8:32 am on June 4, 2003 (gmt 0)

Full Member

10+ Year Member

joined:May 22, 2003
posts:278
votes: 0


Freshbot is visiting .. i keep updating my index page every week .. the new updates are indexed and stay in the results for 2 days max then turn back to mid-march cache .. rest of the internal pages remain the same throughout.
5:46 pm on June 5, 2003 (gmt 0)

New User

10+ Year Member

joined:June 2, 2003
posts:39
votes: 0


I am getting various address's from my logs that start with 216. Are these definatly spiders or could they be normal traffic etc?
12:42 am on June 6, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Sept 2, 2002
posts:446
votes: 0


Could be normal traffic or other spiders. (Scooter starts with 216.)

I believe Freshbot is usually 64.68.82.* . Deepbot is the one that usually starts with 216.239. And, lately, there has been speculation that freshbot is doing the job of deepbot.

Beth

1:39 am on June 6, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 4, 2002
posts:1687
votes: 0


216.x.x.x is a a big chunk of territory... my dynamic ISP in Canada often assigns me that IP#.

Fresh is/was 64.68.x.x and and there's a new one that starts with 64 (can't remember the rest, saw it in the logs...)
Deep is/was 216.239.x.x
Scooter is 216.39.x.x

6:50 pm on June 5, 2003 (gmt 0)

New User

10+ Year Member

joined:Apr 19, 2003
posts:14
votes: 0


I only saw 2 days that the freshbot refreshed pages during this months update. Has anyone else noticed this? I remember, when google was updating regularly, you would have a couple weeks of fresh updates.

Not even the news sites have fresh tags lately.

This 211 message thread spans 15 pages: 211
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members