Forum Moderators: bakedjake

Message Too Old, No Replies

Agent: Solnet-SwishSpider

Found this in my server logs, what this?

         

Martin Galloway

12:50 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



Amidst the furore that is surrounding the search engines in the last week. I discovered several hundred pages that had been spidered by "Agent: Solnet-SwishSpider" at 7:00 am this morning, does anyone know who they are?

I have never seen nor heard of them before and even a search on Google and MSN doesn't return any results.

Thank you.

Martin.

runarb

1:54 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



SwishSpider is the spider for Swish-e. See [swish-e.org...]

Swish-e is a fast, flexible, and free open source system for indexing collections of Web pages or other files. Swish-e is ideally suited for collections of a million documents or smaller.

- [swish-e.org...]

Martin Galloway

2:26 pm on Apr 20, 2006 (gmt 0)

10+ Year Member



runarb:

Thank you for the information. If this is an open source spidering system, I am wondering why it would be visiting my site without invitation and looking at so much stuff.

Does it come around on it's own, or is it some sort of user activated indexing system?

Appreciate you poppin in.

Martin.

Dave_A

1:26 am on Apr 25, 2006 (gmt 0)

10+ Year Member



Hi Swish is a small scale search engine, the software can be set up to run a small search engine.
The crawler for it leaves that User Agent string so it was probably someone trying to set up a small search engine..