Welcome to WebmasterWorld Guest from 220.127.116.11
Forum Moderators: open
I bet they would cut their spidering costs down by over 90% and make webmasters much happier if there was a Big Red Index Me! Button So for example, I would press the button and all URL's in my account are refreshed within 6 hrs or something.
I'm happy because I don't get upset if the spider is late after 48 hrs, and I get my content in faster, and they save a lot of money, WIN-WIN!
I was just thinking it would save them a ton of cash to not have to re-spider pages that never change in content, let the user decide when it's time to refresh.
For example, I probably would only press my big red button 2-3x a month as I upload pages and new content. Compared to 15x a month, thats a huge savings in bandwidth.