Welcome to WebmasterWorld Guest from 23.22.46.195

Forum Moderators: open

spidering speed

How fast is fast...

   
12:48 pm on Dec 29, 2002 (gmt 0)

10+ Year Member



Seems that I have been visiting by the Fast Webcrawler, it only picked up my robots.txt file.

When is it likely that it will crawl through the html-pages?

2:06 pm on Dec 31, 2002 (gmt 0)

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



It should happen within 7 days to two weeks. If it is a new site, it may be up to one month before it is picked up entirely.
 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month