Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| mercator.pa-x.dec.com |
4 | RealSpices | 4:42 am Mar 11, 2000 | ||||
| types of spiders |
5 | priya | 11:34 am Mar 8, 2000 | ||||
| AllTheWeb |
6 | David | 3:44 am Mar 4, 2000 | ||||
| I dont know these |
5 | don_j | 3:55 am Mar 2, 2000 | ||||
| regd search engine submission |
3 | priya | 2:16 pm Feb 23, 2000 | ||||
| Can't figure this one out. |
2 | Why_me | 10:17 am Feb 16, 2000 | ||||
| Free Spiders or Suggestion |
2 | Suds | 12:41 pm Feb 12, 2000 | ||||
| Scooter/2.0 G.R.A.B. V1.1.0 |
6 | Pete | 5:04 pm Feb 1, 2000 | ||||
| About absolute/relative URLs |
3 | Fabrizio | 7:21 am Jan 29, 2000 | ||||
| New Babelfish Spider Detected |
3 | fantomaster | 3:25 am Jan 26, 2000 | ||||
| Anyone have an answer for this one? |
3 | RealSpices | 7:01 pm Jan 17, 2000 | ||||
| Looking for recent Robots.txt info. |
2 | CentricTAG | 11:47 am Jan 11, 2000 | ||||
| PJspider |
2 | BigMike | 1:37 am Dec 30, 1999 | ||||
| New Alta ips |
2 | Brett_Tabke | 2:08 am Dec 15, 1999 | ||||
| Inktomi Fakers |
2 | Brett_Tabke | 4:25 am Nov 20, 1999 | ||||
| New Google IP's |
3 | Brett_Tabke | 1:20 am Nov 14, 1999 | ||||
| New Inktomi IP |
5 | ulstrup | 8:36 pm Nov 5, 1999 | ||||
| What is Teleport Pro/1.29 |
2 | censor | 7:17 pm Oct 11, 1999 | ||||
| New SE IP's |
4 | ulstrup | 12:17 pm Oct 8, 1999 | ||||
| Mercator spider |
6 | \Lizard! | 8:08 pm Sep 27, 1999 |
