Forum Moderators: open

Message Too Old, No Replies

Clarification on freshbot and googlebot

         

askjoe

8:57 pm on Feb 5, 2003 (gmt 0)

10+ Year Member



OK, here's what I understand so far. Freshbot crawls the web looking for new/modified websites then immediately posts them for a day or two - when this happens, googlebot is set to spyder the site later in the month.

Freshbot may or may not come back to your site once it finds it - for the first month you appear in and out of google's listings because of this.

Once googlebot comes and spiders your site you're basically in google's system at that point.

All this has an approx time period of 1 month?

Could you guys please confirm this and/or clarify it fully. Basically I'm trying to get freshbot to come back to my site. It came for the first time last week but has since left - along with my listings.

How can I get freshbot to come back - I've changed my site up and added more content since then. Looking for suggestions.

Thank you

Stefan

9:58 pm on Feb 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



You pretty much have it figured out.

"All this has an approx time period of 1 month?"

It can take close to two months depending on the timing.

You'll be in for sure during the next update. Until then there's nothing you can do except be patient and happy that Google found you and keep working on the site.

<added>...and hoping that freshie might decide to drop by again</added>

Jesse_Smith

10:15 pm on Feb 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



:::when this happens, googlebot is set to spyder the site later in the month.

When you get listed as a Fresh update, it doesn't guarentee that the pages will be listed at the next update. On about the 15th of last month I saw about 500 pages that I had just created a few days earlier get added for a few days and then droped, and they were not added at the update at the end of the month.

Stefan

10:22 pm on Feb 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yeah... I realized after I'd posted it that it wasn't guarranteed that he'd get in at the next update. With no sign of deepbots and freshbots everywhere though, you never know. There's no way to force freshie to come back so patience, working on the site, and getting backlinks is all he can do.

<added>The thing is too that we'll either get deepcrawled before the next update, or they'll have to use freshbot results. I haven't seen a deepcrawl since first part of Jan... I cant' see them using results that stale for the next indexing.</added>

Rick_M

1:11 am on Feb 6, 2003 (gmt 0)

10+ Year Member



FYI: the googlebot is now doing it's main crawl of my site:

216.239.46.101
216.239.46.116
216.239.46.118
216.239.46.121
216.239.46.124
216.239.46.136
216.239.46.164
216.239.46.165
216.239.46.184
216.239.46.19
216.239.46.204
216.239.46.223
216.239.46.239
216.239.46.27
216.239.46.36
216.239.46.43
216.239.46.48
216.239.46.60
216.239.46.66
216.239.46.75
216.239.46.87
216.239.46.96

have all hit me today.

Stefan

1:19 am on Feb 6, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



At last... thanks rick, not here yet but I'm watching. Askjoe, you'll be in the next update.