homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

picsearch is currently indexing pictures

 8:50 am on Mar 3, 2001 (gmt 0)

Here is a new one that hit our site yesterday. They are looking for pictures. Went to the site but it is not open for business yet. They are from Sweden. The only thing it requested so far was robots.txt. I'm going to add them to it as soon as I finish here.

ps.direct2internet.com - - [02/Mar/2001:13:06:41 -0500] "GET /robots.txt HTTP/1.0" 200 1800 "-" "psbot/0.1 (+http://www.picsearch.org/bot.html)"




 9:29 am on Mar 25, 2001 (gmt 0)

Did they come back, and if they did, were they very agressive? There are some of those image bots that are just lethal. I had one do 100 requests a minute. That isn't bad if you only have a 100 or so graphics, but this was an archive with 8k graphics and icons...whew.


 9:46 am on Mar 27, 2001 (gmt 0)

So far they have not come back.

> There are some of those image bots that are just lethal.
That's what I was thinking as soon as I found out that they were looking for images. Lucky for us, we have fewer than ten and they are small.


 8:14 pm on Mar 27, 2001 (gmt 0)

note: this hostname resolves to

I was unable to resolve it directly, but I already had the IP number listed for picsearch and I did a reverse DNS lookup on the IP and the hostname matched.



 8:57 am on Apr 4, 2001 (gmt 0)

We at picsearch are still developing our software. We are using a load spread technique to ensure that a domain should not be hit more than once every ten minutes.

The service we will provide will be public and free of charge. We are not "stealing" pictures but merely downloading them to create searchable thumbnails. References to the original picture and the page it was indexed from are always provided with the search results.

www.picsearch.org and www.picsearch.org/bot.html will be updated with more information during the day.

For more information, please contact info@picsearch.org


 4:24 am on Jun 5, 2001 (gmt 0)
psbot/0.1 (+http://www.picsearch.org/bot.html)

I noticed a different IP. I can't get on whois.ripe.net now to see who owns that block.

The thing did NOT request robots.txt


 4:59 am on Jun 5, 2001 (gmt 0)

Sorry,, did request robots.txt.

I read the FAQ on their site. Anybody know where the 'thumbnails' are used?


 12:32 pm on Jun 5, 2001 (gmt 0)

In the same manner as most other picture search engines, picsearch will use the thumbnails to provide previews of the search results.

Other questions can be sent to info@picsearch.org.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved