Forum Moderators: open
Interesting behaviour. First time it came was about a week ago and requested robots.txt and my rss feed.
Then a couple of days ago it came again and took about 50 of my newest pages. (Newest pages as of a week ago). Well I never have ~50 pages in the rss file at one time so it wasn't a straight "read rss file now and spider them all a week later" function.
I've seen "YahooSeeker/CafeKelsa-dev (compatible; Konqueror/3.2; FreeBSD ;cafekelsa-dev-webmaster@yahoo-inc.com ) (KHTML, like Gecko)" around March/April but it had pretty random spidering. This one was different.