Just wondering, is it needed or not? I think the robots default is index and follow? your thoughts
not2easy
4:07 pm on Jun 7, 2025 (gmt 0)
You are right, but that applies to Googlebot. 'Most' bots also follow by default and if there is no "noindex" found, they will index. (if that's what they are doing there). Most open source bots, some commonly used for scraping, have settings they can alter. If the bot is not from a SE, they are not likely to be there for indexing.
lucy24
4:17 pm on Jun 7, 2025 (gmt 0)
I saw the topic title and thought it was introducing a robot calling itself “Meta Name”.
There's no need to add an element that just says “do whatever you would have done anyway.” (And while you’re cleaning up, get rid of any and all "keywords" metas. I doubt any entity in the world uses it for anything.)
Come to think of it, cleanup in the <head>* may merit a whole thread of suggestions. For example, some years back, I globally reduced <style type = "text/css"> to <style> and-that’s-all.
* Hmm. Sounds military, doesn’t it.
henry007
5:26 pm on Jun 7, 2025 (gmt 0)
Keywords where OK I think when you and I where around many years ago, Your idea of a new thread is a good one! why dont you fire it up
