Welcome to WebmasterWorld Guest from

Forum Moderators: mack

Message Too Old, No Replies

Sudden Drop in Crawl Rate

Bing seems to have shyed away from us suddenly...

7:10 am on Oct 3, 2011 (gmt 0)

Junior Member

5+ Year Member

joined:Apr 17, 2009
votes: 0

Hi All,

I'm writing to ask about Crawl Rates and any possible blockers that anyone knows about when it comes to Bingbot.

Last month Bingbot suddenly seemed to have dropped crawls to our website. Previously hovering around the 150,000 per day mark to now at 2,800 mark...

Our site has around 3,000,000 pages. Half of which have been indexed by Bingbot successfully.

I can't seem to find any logical explanation to the change.

I checked the robots.txt & sitemap.xml files for any problems but none there.
We've not had any releases into production immediately before the drop or after.

Traffic is constant from Bing and hasn't dropped abnormally. Indexation is still constant and hasn't dropped in a similar way.

@Bingdude...are you able to help shed some light on this situation?

Anyone else able to assist? Provide some suggestions perhaps on something I may have overlooked?

Thank you :)
3:06 pm on Nov 9, 2011 (gmt 0)

Junior Member

5+ Year Member

joined:Jan 5, 2011
votes: 0

Usually this is indicative of their users (bing) bouncing off of your site more quickly then your competitors. This is a documented portion of the bing algo.

Work on refining search conversion features to decrease bounce - more cross linking of pages, rewrite content to be more engaging, etc.