homepage Welcome to WebmasterWorld Guest from 54.167.138.53
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
IE "Synchronize Offline while idle" is killing me
Synchronize Offline
Helice

10+ Year Member



 
Msg#: 188 posted 9:07 pm on Nov 5, 2003 (gmt 0)

I have some site members who have set my site's dynamic entry page as their homepage, and set their IE 6 browsers to synchronize the home page while their computers are idle. This results in several people from major ISPs like AOL downloading my index page tens of thousands of times per day, each.

Is there a way I can prevent them from doing this without blocking all IE browsers, or all AOL IPs? The bandwidth and performance hits are strangling me to death.

Thanks in advance for help.

 

sun818

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 188 posted 9:12 pm on Nov 5, 2003 (gmt 0)

You could try putting this at the root:
[webmasterworld.com...]

(wow! PR4 for a robots.txt - unbelievable!)

Helice

10+ Year Member



 
Msg#: 188 posted 12:46 am on Nov 6, 2003 (gmt 0)

Ah... it was "msiecrawler".... I think that'll do the trick. Thanks.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved