Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Thank you Yahoo SlurpConfirm404 |
17 | fiestagirl | 2:06 am Aug 22, 2005 | ||||
| Odd UA? |
3 | mcneely | 12:33 am Aug 22, 2005 | ||||
| Multiple UA's |
2 | wilderness | 7:44 pm Aug 21, 2005 | ||||
| Helix/1.2 |
3 | bull | 12:16 pm Aug 21, 2005 | ||||
| Poodle_predictor_1.0 For the dogs or what? |
6 | mcneely | 12:30 pm Aug 20, 2005 | ||||
| OmniExplorer Crawler Should I continue to let this spider hammer my sites? |
3 | FlipFlops | 6:10 am Aug 20, 2005 | ||||
| What's your spider traffic look like? |
4 | walnut99 | 6:03 am Aug 20, 2005 | ||||
| What is agent::_detectURL? |
2 | Joey123 | 7:09 pm Aug 19, 2005 | ||||
| ::_detectURL deprectated crawling from APNIC |
4 | bull | 6:40 pm Aug 18, 2005 | ||||
| Tecomi Bot? |
6 | innocbystr | 7:56 am Aug 18, 2005 | ||||
| New Google Bot UserAgent Google Bot Spoofing Nokia6820 |
2 | Ocean10000 | 7:49 am Aug 18, 2005 | ||||
| n_spe_afhfpacolsj7agppbkl info on this? |
4 | mcneely | 5:12 am Aug 16, 2005 | ||||
| user agent: www.zatka.com Appears to be a new Indian search engine that doesn't read robots.txt |
3 | GaryK | 12:26 am Aug 16, 2005 | ||||
| Yahoo bot? |
12 | webzilla | 12:20 am Aug 16, 2005 | ||||
| twtelecom.net bot identifying as Konqueror Doesn't read robots.txt |
7 | abates | 9:21 pm Aug 14, 2005 | ||||
| larbin_2.6.3 wgao@genieknows.com Is this a real spider bot? |
5 | Riamus | 8:19 pm Aug 11, 2005 | ||||
| YahooSeeker/CafeKelsa-dev Yet another new Yahoo Bot? |
2 | bobothecat | 4:47 pm Aug 11, 2005 | ||||
| Googlebot IPs? Trying to determine a current list of IPs for Googlebot |
6 | Riamus | 6:21 pm Aug 10, 2005 | ||||
| BilderSauger |
4 | wilderness | 2:08 am Aug 8, 2005 | ||||
| bcentral.com? has anyone seen this activity? |
8 | tallis | 1:48 pm Aug 5, 2005 | ||||
| schibstedsokbot? This is a new one on me!? |
5 | Friday | 9:30 pm Aug 4, 2005 | ||||
| Hurricane Electric 570 MB in two hour period[2] ( 1 2 ) |
51 | OptiRex | 1:08 pm Aug 4, 2005 | ||||
| Gigabot/2.0 Is this legit? |
23 | dataguy | 2:16 am Aug 4, 2005 | ||||
| Who is "64.210.196.***"? I'm seeing this in my logs on very different domains. |
5 | fischermx | 3:24 am Aug 3, 2005 | ||||
| Ultimate short list of banned bots Wanna contribute? |
17 | silverbytes | 8:34 am Aug 2, 2005 |
