| 2:00 am on Mar 17, 2002 (gmt 0)|
Was it part of an html tag, or in the keywords meta tag?
| 2:32 am on Mar 17, 2002 (gmt 0)|
meta tag it had a description tag, a keyword tag, then below htdig-keywords...
| 2:56 am on Mar 17, 2002 (gmt 0)|
ht://dig [htdig.org] has been around in form or another since 1995. It was one of the first good internal search engines.
Note the word "internal" in that sentence. ht://dig is for organizations that want to search their own networks. It's not meant to spider sites outside it's owner's network.
The "htdig-keyword", obviously, is only useful if you're running ht://dig on your site.
| 3:50 am on Mar 17, 2002 (gmt 0)|
thanks. for me it was a ho-hum site, and it ranked high on my search, so i decided to sneak on the code to see, until i noticed that meta, which duplicated the keywords. so i asked
| 11:32 am on Mar 30, 2002 (gmt 0)|
>It's not meant to spider sites outside it's owner's network
Well it made 68 requests to my site yesterday and I am not in any network.