Forum Moderators: open

Message Too Old, No Replies

Datasift

data analysis

         

keyplyr

11:52 pm on Dec 4, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



DataSift pretends to be Googlebot to scrape social data, blog data and news data:
185.20.4.201 - - [04/Dec/2016:01:56:23 -0800] "GET /example-page.html HTTP/1.1" 403 4771 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)"
datasift.com
185.20.4.192 - 185.20.4.223
185.20.4.0/22

keyplyr

5:29 pm on Dec 5, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



More sneaky sifting from DataSift:
185.20.4.220 - - [05/Dec/2016:01:58:12 -0800] "GET /example-page.html HTTP/1.1" 403 4771 "-" "Mozilla/5.0 (TweetmemeBot/4.0; +http://datasift.com/bot.html) Gecko/20100101 Firefox/31.0"