Forum Moderators: Robert Charlton & goodroi
I have a page with this meta tag:maha, I've never seen this before, but I did a search on a partial text string from the tag that I thought might be mentioned in html text somewhere in a discussion about this tag... and therefore findable via search....
<meta name="st:robots" content="nofollow, noindex">
Robots Meta Tag Support
The Swiftype web crawler supports the robots meta tag standard. This allows you to control how Swiftype indexes pages on your site.
Does it mean all the links in this page are "nofollow"?Yes, but note that the st tag applies to Swiftype only. The "noindex" attribute should keep anything on the page from appearing in the Swiftype search results, and the "nofollow" attribute should keep the st bot from crawling any of the links on that page. A "nofollow" robots meta in Google also keeps PageRank from circulating through that page. Not clear that Swiftype's algo has anything analogous to those kinds of considerations.
I cannot figure out if this means all bots (including Googlebot) are block? Sounds like it doesn't.