joined:Apr 17, 2009
I'm writing to ask about Crawl Rates and any possible blockers that anyone knows about when it comes to Bingbot.
Last month Bingbot suddenly seemed to have dropped crawls to our website. Previously hovering around the 150,000 per day mark to now at 2,800 mark...
Our site has around 3,000,000 pages. Half of which have been indexed by Bingbot successfully.
I can't seem to find any logical explanation to the change.
I checked the robots.txt & sitemap.xml files for any problems but none there.
We've not had any releases into production immediately before the drop or after.
Traffic is constant from Bing and hasn't dropped abnormally. Indexation is still constant and hasn't dropped in a similar way.
@Bingdude...are you able to help shed some light on this situation?
Anyone else able to assist? Provide some suggestions perhaps on something I may have overlooked?
Thank you :)