Welcome to WebmasterWorld Guest from 220.127.116.11
Forum Moderators: open
joined:Feb 27, 2003
Welcome to WebmasterWorld [webmasterworld.com]!
The location of your log files would depend on how your hosting service has your account configured. I would recoomend that you check their FAQs, or contact their customer service department.
:::Wouldn't It would be strange for freshbot to crawl that many pages?
Nope, not at all. Some of us get thousands of hits a day from the freshbot.
:::How long will it be before I see the updates from last months deep crawl?
When we start barking up the wall then you can be sure you can see them, er wait we are allready barking up the wall! The next dance will show the updates from last months deepcrawl.
No sign of deepbot this month.
The funny thing is that freshbot is crawling
ten's of thousands of pages that are disallowed
in the robots.txt file. Anyone else seen this