homepage Welcome to WebmasterWorld Guest from 54.196.24.103
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Accredited PayPal World Seller

Visit PubCon.com
Home / Forums Index / Hardware and OS Related Technologies / Linux, Unix, and *nix like Operating Systems
Forum Library, Charter, Moderators: bakedjake

Linux, Unix, and *nix like Operating Systems Forum

    
network cuts off googlebots requests
daniel_o




msg:4608101
 4:26 pm on Sep 7, 2013 (gmt 0)

Hello,

I noticed that ANY http request to my server, with a phrase "googlebot" in its useragent string, is getting blocked on the network level (it's not getting logged by Apache, so it's not a matter of .htaccess nor robots.txt misconfiguration).

And that happens only to successful "200" connections ("404" not found and "301" redirects are working fine).

When I run:
netstat -nat |grep my.ip.here
the connection is only in TIME_WAIT state and then gone.

I flushed firewall and it didn't help much.

Other domains on the server are working fine...

That's really bizarre.

Do you have an idea what's causing it?

I think the server might have been compromised by a malicious hacker who wanted to cut off googlebot.. does anyone know how to fix it?

 

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Hardware and OS Related Technologies / Linux, Unix, and *nix like Operating Systems
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved