Welcome to WebmasterWorld Guest from 184.108.40.206 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Pubcon Platinum Sponsor 2014
220.127.116.11 "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:18.104.22.168; ips-agent) Gecko/20090824 Fedora/1.0.7-1.1.fc4 Firefox/3.5.3" VeriSign Infrastructure & Operations 22.214.171.124 - 126.96.36.199 rDNS: no robots.txt: yes Ate 403s due to a specific attribute in UA
This exact same UA just fell into my robots.txt trap by trying to access something in a disallowed directory around 12:30 Eastern U.S. time. Stevietheman
It was in the same IP range as well. Pfui
Aug. 18th, same IP and UA: 188.8.131.52 Mozilla/5.0 (X11; U; Linux i686; en-US; rv:184.108.40.206; ips-agent) Gecko/20090824 Fedora/1.0.7-1.1.fc4 Firefox/3.5.3 robots.txt? Yes July 25th, next-door IP and same not-okay UA attribute: 220.127.116.11 BlackBerry9000/18.104.22.168 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/102 ips-agent robots.txt? Yes FWIW: Multiple prior years, across multiple sites, none with ecommerce or https -- Some bare IPS: 22.214.171.124 126.96.36.199 188.8.131.52 184.108.40.206 220.127.116.11 Some by Host: crawl3.pub.colo-fo.brn1.verisign.com crawl31.pub.colo.fo.brn1.verisign.com ips-crawl2.colo-fo.ilg1.verisign.com ips-crawl3.colo-fo.ilg1.verisign.com ips-crawl5.colo-fo.ilg1.verisign.com ips-crawl8.colo-fo.ilg1.verisign.com All always using: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7.12; ips-agent) Gecko/20050922 Fedora/1.0.7-1.1.fc4 Firefox/1.0.7 robots.txt? Yes Hmm. I always chalked 'em up to a Network Solutions thing, although the hits never coincided with services/renewals either before or after the corporate changes: "(VeriSign still retains the registry business which had been originally created within Network Solutions prior to VeriSign's acquisition of the company.)" [ ...] en.wikipedia.org Actually, I have no clue why they're crawling. lucy24
Ooh, Verisign, they're the funny ones. They missed last month but generally come by about once a month. And each visit is identical: IP: so far*, always exactly 18.104.22.168 UA (spaces added by my log-wrangling code): Mozilla/ 5.0 (X11; U; Linux i686; en-US; rv:22.214.171.124; ips-agent) Gecko/ 20090824 Fedora/ 1.0.7-1.1.fc4 Firefox/ 3.5.3 ( but wait!) pages, at intervals of 2-5 seconds: /robots.txt / / again, this time with UA BlackBerry9000/126.96.36.199 Profile/ MIDP-2.0 Configuration/ CLDC-1.1 VendorID/ 102 ips-agent /rats/index.html /paintings/index.html /fun/index.html /fun/judy.html /hovercraft/index.html /ebooks/index.html /games/index.html /rats/mischief.html Nine pages (out of 150-ish) in two minutes, once a month, puts them squarely in the "no skin off my nose" camp. I looked them up once but forget what it is they claim to do. * I've only been monitoring raw logs since the end of March, so what happened before then is anyone's guess. jmccormac
The ips-agent is the spider for the website survey that Verisign runs for the Domain Brief report from what I remember (it gives a rough breakdown of 1 page sites to multipage sites on page 3). [ ...] verisigninc.com Regards...jmcc Pfui
VeriSign slips "ips-agent" into another UA: 188.8.131.52 Mozilla/5.0 (X11; U; Linux i686; en-US; rv:184.108.40.206; ips-agent) Gecko/20110905 Ubuntu/10.04 (lucid) Firefox/6.0.2 robots.txt? Yes Project Honey Pot for the IP [ ...] shows 4,000-plus visits within a year using four UAs to date: projecthoneypot.org BlackBerry9000/220.127.116.11 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/102 ips-agent Mozilla/5.0 (X11; U; Linux i686; en-US; rv:18.104.22.168; ips-agent) Gecko/20090824 Fedora/1.0.7-1.1.fc4 Firefox/3.5.3 Mozilla/5.0 (X11; U; Linux i686; en-US; rv:22.214.171.124; ips-agent) Gecko/20090824 Fedora/1.0.7-1.1.fc4 Firefox/3.5.3,gzip(gfe),gzip(gfe) Mozilla/5.0 (X11; U; Linux i686; en-US; rv:126.96.36.199; ips-agent) Gecko/20110905 Ubuntu/10.04 (lucid) Firefox/6.0.2 Doubtless there will be more.