Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Twitterbot follow-up to old thread |
3 | GaryK | 6:04 am Sept 16, 2010 | ||||
| iSense bot When will these bots learn to read? |
5 | Dijkgraaf | 7:23 pm Sept 15, 2010 | ||||
| Huaweisymantecspider |
4 | Dijkgraaf | 6:55 pm Sept 15, 2010 | ||||
| SaladSpoon/ShopSalad Bad bots never die, they just smell that way |
4 | Dijkgraaf | 10:00 pm Sept 13, 2010 | ||||
| Bingbot Reminder, October 1 |
3 | engine | 9:15 pm Sept 11, 2010 | ||||
| czxt2s User Agent? What is this? Very odd. |
20 | grandma_genie | 4:43 pm Sept 9, 2010 | ||||
| Adware or Spyware in User Agent string Is this a problem or just infected visitor? |
16 | grandma_genie | 4:28 am Sept 7, 2010 | ||||
| Sitedossier possible data miner |
3 | Mokita | 4:17 am Sept 7, 2010 | ||||
| HBZ-Digibib |
2 | Pfui | 10:45 pm Sept 3, 2010 | ||||
| Dom2Dom |
15 | Pfui | 11:10 pm Sept 2, 2010 | ||||
| thenewpush.com Server farm pushes bad/fake UAs |
2 | Pfui | 9:35 pm Sept 2, 2010 | ||||
| What is heritrix? Who is Darwin? Found in User Agent. Should I block these? |
12 | grandma_genie | 7:17 pm Aug 31, 2010 | ||||
| Who is Tweatbot? Found this bot all by itself in server logs. |
6 | grandma_genie | 3:43 pm Aug 31, 2010 | ||||
| Microsoft Bing Mobile SocialStreams Bot |
3 | Pfui | 12:28 am Aug 30, 2010 | ||||
| PSS-Bot |
2 | keyplyr | 10:19 am Aug 26, 2010 | ||||
| msnbot to bingbot? |
2 | keyplyr | 6:53 am Aug 25, 2010 | ||||
| crawl.mp3realm.org Another maggot. |
2 | jmccormac | 5:51 pm Aug 24, 2010 | ||||
| schluetersche German bot |
3 | Dijkgraaf | 4:21 am Aug 24, 2010 | ||||
| Who is Kosmix? New crawler sighted in server logs. |
14 | grandma_genie | 10:02 pm Aug 21, 2010 | ||||
| zerozero88 |
3 | MxAngel | 12:34 am Aug 21, 2010 | ||||
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:x.x.x) Gecko/200411 Fake UA |
2 | Dijkgraaf | 4:27 am Aug 20, 2010 | ||||
| Hailoobot New Search Engine for Middle East |
3 | Dijkgraaf | 2:06 am Aug 19, 2010 | ||||
| Ukrainian Academic and Research Network Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC |
2 | Dijkgraaf | 10:28 pm Aug 17, 2010 | ||||
| extrabot |
2 | Pfui | 2:12 am Aug 17, 2010 | ||||
| New Bot On The Block IBM Bot Named SAI-Crawler |
3 | SevenCubed | 6:10 am Aug 16, 2010 |
