Forum Moderators: open

Message Too Old, No Replies

Freshbot question.

         

Jesse_Smith

9:21 pm on Mar 4, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It it normal for the freshbot to get your pages but not list them? Two days ago it grabed 1,846 of my files, but never listed them. It still only lists 59 of the files, the ones that it has refused to delist for the last three weeks. The date shows Mar 3, 2003.

aspdesigner

4:54 am on Mar 5, 2003 (gmt 0)

10+ Year Member



Yes, it doesn't always list all the pages it spiders.

lazerzubb

6:26 pm on Mar 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



As stated, it doesn't always list the pages.
I saw a very big freshbot crawl on the 3 of march, and most of the pages which where spidered was not listed the day after, or the day after that.

More about the Freshbot can be found at:
Googlebot: Deepbot and Freshbot FAQ and Information [webmasterworld.com]