Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| DotBot |
9 | lucy24 | 6:22 pm Aug 14, 2021 | ||||
| Odd UA acting bad |
3 | tangor | 5:46 pm Aug 13, 2021 | ||||
| Vagabondo / WiseGuys |
5 | dstiles | 9:20 am Aug 11, 2021 | ||||
| Bingbot on 13.66.139.0/24 Seems to have ended? |
6 | SumGuy | 4:34 pm Aug 1, 2021 | ||||
| Screaming Frog only crawls /en/ pages |
7 | jediviper | 6:50 am July 26, 2021 | ||||
| Google-AMPHTML bot Undocumented Google crawler? |
7 | Giacomo | 7:36 pm July 15, 2021 | ||||
| Sec-Fetch-* headers Are there any modern browsers using them? |
26 | blend27 | 2:47 am July 13, 2021 | ||||
| Atomseobot |
3 | lucy24 | 9:13 pm July 4, 2021 | ||||
| Cloud Server with Rogue Bot 154.127.52.0/24 |
7 | Bewenched | 3:40 pm July 2, 2021 | ||||
| Server Farms January 2021 Continuing discussion of hosting and data center IP ranges |
24 | not2easy | 2:47 am July 2, 2021 | ||||
| Dataproviderbot Same as Dataprovider spider? Relationship with google? |
2 | SumGuy | 5:25 pm June 23, 2021 | ||||
| Lets talk about VPN Ranges or what is it that determins a real visitor using VPN vs.Bots |
6 | blend27 | 12:40 pm June 10, 2021 | ||||
| MixrankBot MixrankBot |
2 | WebOpz | 4:27 pm June 3, 2021 | ||||
| Cyrillic pagenames An annoying advertising method? |
11 | dstiles | 9:40 am June 2, 2021 | ||||
| adreview/1.0 adreview/1.0 |
3 | WebOpz | 6:12 pm May 25, 2021 | ||||
| Oh, the old UAs Trying to archive some old data here... |
11 | blend27 | 4:09 pm May 24, 2021 | ||||
| LCC Bot |
4 | WebOpz | 3:44 pm May 20, 2021 | ||||
| Bingbot, Robots.txt and Port 80 or When Will Bingbot Grow Up? |
17 | dstiles | 10:32 am May 12, 2021 | ||||
| TkBot |
3 | lucy24 | 4:40 am May 12, 2021 | ||||
| Seekport Crawler I think first time seeing this? |
2 | SumGuy | 12:35 am May 8, 2021 | ||||
| LinuxGetUrl/2.0 |
11 | WebOpz | 4:50 pm Apr 28, 2021 | ||||
| Is there a UA setting that allows all Google Bots? |
13 | born2run | 11:15 am Apr 24, 2021 | ||||
| The Knowledge AI The Knowledge AI |
4 | WebOpz | 2:30 pm Apr 23, 2021 | ||||
| Search bot operating on OpenDNS IP address? Anyone seen this before? |
8 | SumGuy | 2:27 pm Apr 20, 2021 | ||||
| M247 - Part II Unfortunately here we go again. |
3 | blend27 | 1:04 am Apr 17, 2021 |
