homepage Welcome to WebmasterWorld Guest from 107.22.141.14
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

This 63 message thread spans 3 pages: < < 63 ( 1 2 [3]     
Thousands of Spambot IPs Hitting my Site
Thousands of Spambot IPs Hitting my Site
spiritualseo




msg:4396671
 6:19 pm on Dec 11, 2011 (gmt 0)

Hey guys, need someone's help here. From the past week or so the bandwidth usage of my site increased from 1GB a month to 12GB a Day!

Awstats indicates that there are a range of unique IPs hitting my site and requesting thousands of pages with every visit. Most of these IPs seem to be originating from within the US which is funny. I have blocked China, Brazil and some other countries in my HTaccess but the hits continue.

Please take a look at these ips, these are just a few from thousands that hit my site almost every second. And each one requests around 1000 pages. My site has only around 100 pages so perhaps they request a page over and over again:

24.181.178.3
216.6.134.27
70.182.254.242
99.98.188.110
75.134.95.208
65.35.111.110
71.197.69.88
124.123.51.38
173.198.98.134
198.138.135.123
24.159.55.211
50.40.131.171
174.16.100.103
74.131.129.17
75.94.108.222
98.218.136.190
69.244.107.77
68.185.252.101

The funny thing is that all of them look unique and all of them have a verified DNS. How can this be?

Can anyone please explain what is happening? And what can I possibly do to stop this? If this continues, my site will go offline within a week or so.

 

shivachettri




msg:4414569
 11:29 pm on Feb 5, 2012 (gmt 0)

Hey there spiritualSEO, could you help me by dropping in the .htaccess code that you used for solving this. I too am having the very same problem and I am pretty new to this .htaccess stuff. It would really be very kind of you

tangor




msg:4414580
 1:19 am on Feb 6, 2012 (gmt 0)

Just a reminder "Trident" is the layout engine for IE. See: [en.wikipedia.org...] for a list of other applications (includes some google stuff) which also rely on Trident.

Blank referers are a problem, of course, and how one deals with those is a personal choice as I don't believe there is a cut-and-dried method in that regard.

lucy24




msg:4414591
 2:54 am on Feb 6, 2012 (gmt 0)

Hm, I was just going to go look for a moderator to suggest that this new question might get better attention if it were snipped off to a new thread that isn't three pages long with a six-week gap in the middle ;)

This 63 message thread spans 3 pages: < < 63 ( 1 2 [3]
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved