Northern Light?

does it only use meta tags?

[skirril]

Hello,

I have reason to believe, Northern Light only uses the Meta Tags on a page, and doesn't index it fully. All its robot ever did at my site was issue "HEAD /somepage" commands, which obviously just gets you the head of the page.

Skirril

[Brett_Tabke]

Well, NL does to head checks as link checking and time stamping. If you use the "Expires" conditional header, the server should report whether the page has been updated or not. That doesn't always work with pages that have dynamic content such as ssi (the server can return the current time).

NL uses the head check more than any other engine. Alta used to use it quite a bit, but I've not noticed it lately.

This is why it is good to delete the file on the server and upload a new copy when targeting NorthernLight because it updates the file time and inode time without question.

[skirril]

So a file of the kind:

some html here

<--! include some file here -->

some html here

won't change its timestamp if I change the included file?

Interesting..