Forum Moderators: Robert Charlton & goodroi
Today, Yahoo did the same with a couple of pages.
Does anyone has any idea why both bots do that?
Many thanks in advance.
I looked over my logs and in fact the request of each of the bots is for two different pages with querystring/ per bot. They just requested these pages several times.
I tried a search for the URL but / is ignored even when between " " .
I guess I'll just have to wait till wherever the bots get the link from is sending a visitor directly or something else comes up that clears it all up.
Many thanks everyone for your input.