Requested robots.txt, then home page w/ all the trimmings, then robots.txt, then an old, now nonexistent (404) page.
incrediBILL
10:03 pm on Feb 13, 2010 (gmt 0)
That's not a cloaked bot, that's the new UA for their screen shot tool.
That's why it downloads all the files.
jdMorgan
10:16 pm on Feb 13, 2010 (gmt 0)
iBill,
Do you know if their previously-used "Lynx" and "Minefield" UAs are still in use? I'd love to get rid of a few rules if so...
Jim
keyplyr
12:34 am on Feb 14, 2010 (gmt 0)
@ incrediBILL
Ahhh, thanks
incrediBILL
9:16 am on Feb 14, 2010 (gmt 0)
Do you know if their previously-used "Lynx" and "Minefield" UAs are still in use? I'd love to get rid of a few rules if so...
The prior version I'm aware of was Minefield until just recently.
These are all just special beta versions of Linux Firefox, you can find out the latest name on Mozilla or somewhere as I know I did once upon a time just to validate it.
