Forum Moderators: goodroi

Message Too Old, No Replies

Can you specify multiple user-agents before a single Disallow?

         

stephen22

9:54 pm on Oct 24, 2024 (gmt 0)

Top Contributors Of The Month



In a robots.txt file, can you specify multiple user-agents with a single Disallow, like this:

User-agent: 007ac9
User-agent: spbot
User-agent: DotBot
User-agent: SeznamBot
User-agent: AwarioRssBot
User-agent: AwarioSmartBot
Disallow: /


Or do you need the Disallow for each one:

User-agent: SeznamBot
Disallow: /
User-agent: AwarioRssBot
Disallow: /
User-agent: AwarioSmartBot
Disallow: /