Forum Moderators: phranque
How may i implement a code that will whitelist opt in only with a rDNS check at the same time.
For example i would like only the major three engines to crawl my site
with a reverse DNS look up to validate them.
And at the same time punting to the kerb any other agents including and not limiting to blank user agents.
Much appreciated if anyone can show me a code to drop or come up with one for all of us to use.
There are some old links in either this forum or the SSID forum ( [webmasterworld.com...] ) for white-listing beginnings. Frequent updates are necessary.
My own htaccess is rather simple (KISS; Keep It Simple and Stupid) and I don't comprehend all the socalled-wild card regex lines (although I use some).
Nor do I use DNS or domain checks. Both of these requests may become CPU heavy.
Sorry I couldn't help more.
Don