| Welcome to WebmasterWorld Guest from 220.127.116.11 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Pubcon Platinum Sponsor 2014|
How fast is fast...
Seems that I have been visiting by the Fast Webcrawler, it only picked up my robots.txt file.
When is it likely that it will crawl through the html-pages?
It should happen within 7 days to two weeks. If it is a new site, it may be up to one month before it is picked up entirely.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved