Forum Moderators: open
I have a large site and content is updated regularly through the database.
If the bot uses the file last modified attribute of the pages then it will alway appear not updated.
If the bot compares the last crawled page with the new it will appear modified.
People have mentioned adding a date to the page to make it appear modified every crawl but this will only help if it compares pages and does you the file last modified.
Any ideas?
[webmasterworld.com...]