Welcome to WebmasterWorld Guest from 220.127.116.11
Forum Moderators: mack
First time poster here, so please be kind :).
Anyone have insight in the following situation with MSN search?
I noticed that many of my high ranking pages for my keywords are gone from MSN search results, including my home page.
Finally, when I typed in my website's name, I did get a result for the root domain, www.mydomain.com, even when the keywords did not.
However, the cached content was a page titled "Under Construction" and had content that said "The site you were trying to reach does not currently have a default page. It may be in the process of being upgraded. Please try this site again later. If you still experience the problem, try contacting the Web site administrator." It references "pagerror.gif".
No such page exists on my server so the content isn't indexed from a page it got redirected to if the case was a server issue. Plus this isn't the default for my hosting company so I don't think MSNbot indexed this content off my server when they were doing something because it would have been a different looking page.
My only theory is:
For some reason (network congestion, etc.) the MSNbot couldn't crawl the site and that the "Under Contruction" page is something that MSN themselves generated to use as a default cache if a page or site could not be reached.
Then, it dumped all the pages, except www.domain.com, it tried to index that day out of the search results.
But that kinda doesn't make sense. You would think that it would simply try again later at least once or twice more before booting all those pages out of the search results.
Some other facts that might help with deductions:
Pages from my site still exists in the search results, but they are older, probaby meaning they didn't rank well enough to be frequently indexed. So maybe because not attempt was made to index them on the day the site was in accessible to MSNbot they stayed in the search results?
Also, I did 403 the "sohu-search" spider on the day before MSN said it cached the "Under Construction" page. I used a partial IP for my deny (Deny from 220.181.26.). But, I don't think that's even close to MSNbots IP.
Plus, that day I used the exact same deny for another server and it was successfully indexed by MSN the following day. In other words, both had the "deny from" added on the same day. The following day, one site was indexed while the other got the "Under Constuction" page's content indexed.
Hmmm... the above leads me to another question. How accurate is the date you see next the cache link in MSN's search results. Is it an approxmate? Also, is it the actual day the spider visited or the day it is entered into the database or when that cache started to appear in the search results.
Anway, what do you guys think of my situation? A drop in pages views lead me to discovering all this. So, I would love to solve this!
Thanks for your time!