Does any one know avfwclient.sv.av.com?

Forum Moderators: open

Message Too Old, No Replies

Does any one know avfwclient.sv.av.com?

Had a sneaky crawl from this UA

Macguru

1:38 pm on Apr 9, 2001 (gmt 0)

Hi there,

This UserAgent crawled all "entry pages" ( java redirect to home page ) from a site. It did not respected the robots.txt file. Is this a regular crawl? have I been red flagged for human review? Am I turning paranoid? :)

Air

8:58 pm on Apr 12, 2001 (gmt 0)

Do you have an IP to go with that Macguru? It could be a regular AV employee going through the firewall. If you have an IP I'll likely have more info for you.

Macguru

9:08 pm on Apr 12, 2001 (gmt 0)

Of course
here it is 209.73.174.250

I have not yet noticed any change on AV from this site, difficult to type with my fingers crossed...

Air

12:05 am on Apr 13, 2001 (gmt 0)

Great you have the IP, that is the same AV spider crawling with the UA of roach.smo.av.com-1.0 in early December. Can't say any great ranking change took place after it's visit, but it did crawl quite a few pages on a few of my sites.

Some other posts relating to this one:

[webmasterworld.com...]

Macguru

2:15 pm on Apr 13, 2001 (gmt 0)

Thank you Air

I feel a lot better now. AV represents almost 7% of traffic for this site. What made me worry is that this crawl was made in places it wasn't supposed to. The Robots.txt file did not change for months. It was crawlwed in this session but ignored.

Thanks again