Forum Moderators: open

Message Too Old, No Replies

Does freshbot bring googlebot?

Why try to bring freshbot to your site so often?

         

askjoe

10:38 pm on Mar 11, 2003 (gmt 0)

10+ Year Member



What's the purpose of trying to get freshbot to come to your site everyday? Does a freshbot visit induce a googlebot visit? I'm trying to understand why I'm making constant modifications to get this little spider to crawl my little portion of the web so often.

Will it create better listings?

askjoe

11:02 pm on Mar 11, 2003 (gmt 0)

10+ Year Member



Can someone please explain this further because I only had freshbot visit my site twice last month - I got really good listings - this website had never been indexed before.

I just want to know if it's necessary to go crazy with constant page updates or if just a few per month will suffice.

Jesse_Smith

11:04 pm on Mar 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The freshbot IS the Googlebot, er one of the two.

freshBot: 64.68.82.* bah, listed for only a few days, short dinner date then it dumps you.
deepcrawler: 216.239.46.* Good bot, it likes you, listed until death do you depart. So don't make him mad or it will divorce your site. You can divorce the Googlebot by using your robot.txt file. It's much cheaper and faster than going to the courts.

Happy Online

11:13 pm on Mar 11, 2003 (gmt 0)

10+ Year Member



There are many people here who will give you a better answer than I can and point you to some previous discussions within Webmasterworld.

However the reason that I like Freshbot is as follows:-

Basically if you make an update to your website it can be crawled and listed within a matter of days.

Some of the main benefits of this is that obviously you can get your products listed quicker - if something is in the news you can capatilize on the news item while it is still current.

EG Recently Michael Jackson has had a lot of press and searches for Michael Jackson Albums has probably increased significantly - if you can get a web page up, running, crawled and listed while the news item is still hot there are obvious benefits.

It also gives you a chance to expirement with certain Keyword combinations and get a relatively quick result.