lucy24 - 2:28 am on Jan 2, 2014 (gmt 0)
One more contribution to the "What has Bing been smoking?" discussion:
Early in September, msnbot-media abruptly started asking for jpgs in the form
I have never had a /paintings/thumbs/ directory. What I do have-- in plenty-- is directories in the form
for assorted values of /category/. The requested filenames would be valid for this path.
Why did it take me four months to notice? Because I don't pay much attention to image files; I only discovered it because I've just moved sites so I'm paying close attention to all redirects.
Pause here for thanks to the person who recommended TextWrangler to me, because I was able to take a closer look:
-- three major Bing ranges are involved, randomly switching among 65.55, 131.253 and 199.30-- but never 157.5n.
-- in those four months, requests for nonexistent files have been far more numerous than earlier requests for correctly named forms of the same file. Generally 4-6 per file, total. Is that how many 404s it takes them to decide an image doesn't exist?
-- Round 1, running from 11 September to 8 October, requested the entire contents of /paintings/foobar/thumbs/, without the /foobar/ component. They never asked for the newest file, dating from last May; all others were created in 2005 and have had their present address since 2011. Each request was immediately preceded by a www-redirect.
-- Round 2, beginning on 26 November and continuing to the present, involves the entire contents of /paintings/juju/thumbs/ and /paintings/mojo/thumbs/ in random order-- again without the central directory name-- skipping one file from /juju/ that I just added a few weeks ago.
On the other hand they mysteriously omitted one file from /mojo/ that has been around since 2011. To make up for it, they repeatedly asked for a file which-- according to timestamps on my originals-- did not exist until several days after it was first requested. Now, I happen to know that for some unknown period of time my hosts' logs had a glitch causing them to be off by 22 minutes. But three days I would have noticed.
-- The most recent batch came in after I moved sites. Each of these took an instant redirect, just like a human, sticking with the same IP.
-- Prior to 11 September I cannot find any msn/bingbot redirects or 404s that would shed any light on this behavior.