Forum Moderators: open
If a direct request for the page is made it looks like an ordinary one but if javascript is enabled a secondary url is thrown up that looks like this:
GET /?Some-Folder/Some-File.htm~mainFrame HTTP/1.0" 200 14437
Robots, I understood, choose to ignore javascript but I have noticed that upon putting some Adsense code on a page the Google Mediapartners bot promptly comes acalling but requests the file with the method above, not always, but usually.
That's the first thing that is unusual, second and related, is that the kilobytes recorded as being downloaded, 14437 as above, correspond exactly to my index page, not to the individual page in question. Always like that.
So what is the bot actually seeing, index or the subpage ostensibly requested?