Welcome to WebmasterWorld Guest from 22.214.171.124
Forum Moderators: Ocean10000
Interesting behaviour. First time it came was about a week ago and requested robots.txt and my rss feed.
Then a couple of days ago it came again and took about 50 of my newest pages. (Newest pages as of a week ago). Well I never have ~50 pages in the rss file at one time so it wasn't a straight "read rss file now and spider them all a week later" function.
I've seen "YahooSeeker/CafeKelsa-dev (compatible; Konqueror/3.2; FreeBSD ;firstname.lastname@example.org ) (KHTML, like Gecko)" around March/April but it had pretty random spidering. This one was different.
That site in question has nothing to do with commerce. Yahoo Mindset commercial vs. research slider shows as ~99% research.
Yahoo freshbot? :)