Welcome to WebmasterWorld Guest from 35.171.45.91

Forum Moderators: buckworks & not2easy

URL shortened URLs hit by bots.what to do?

     
2:45 am on Sep 26, 2019 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Dec 19, 2004
posts:993
votes: 14


HI so I use bitly url shortener to shorten my urls on my site. However just today I noticed that each of the shortened bitly links were showing huge number of hits which are way above normal daily activity.

What should I do to stop this bot traffic? I don't have access to access-logs for now. Thanks!
3:50 am on Sept 26, 2019 (gmt 0)

Administrator from US 

WebmasterWorld Administrator not2easy is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Dec 27, 2006
posts:4558
votes: 363


If you don't know where the bots are coming from or what UA bots these are I don't see any way on earth to prevent the traffic. If the links are available to the public, they are available to bot traffic. You would need to identify the bots to deal with what they are allowed to do.

(How is this a Social Media Marketing question and not a Search Engine Spider and User Agent Identification question?)
12:17 am on Sept 27, 2019 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member tangor is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 29, 2005
posts:10563
votes: 1122


Is it only your social media links which are affected?
12:54 am on Sept 27, 2019 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:15932
votes: 887


each of the shortened bitly links were showing huge number of hits which are way above normal daily activity.

What should I do to stop this bot traffic? I don't have access to access-logs for now.
If you don't have access to logs, how do you know what URLs are getting hits?
5:09 pm on Oct 16, 2019 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Dec 19, 2004
posts:993
votes: 14


So basically these were all coming from singapore as per Bitly analytics. For now since I donít have the ips I put a challenge on the firewall for sg problem solved for now