homepage Welcome to WebmasterWorld Guest from 54.226.213.228
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
psbot/0.1
picsearch is currently indexing pictures
Son_House




msg:406847
 8:50 am on Mar 3, 2001 (gmt 0)

Here is a new one that hit our site yesterday. They are looking for pictures. Went to the site but it is not open for business yet. They are from Sweden. The only thing it requested so far was robots.txt. I'm going to add them to it as soon as I finish here.

ps.direct2internet.com - - [02/Mar/2001:13:06:41 -0500] "GET /robots.txt HTTP/1.0" 200 1800 "-" "psbot/0.1 (+http://www.picsearch.org/bot.html)"

[picsearch.org...]

 

Brett_Tabke




msg:406848
 9:29 am on Mar 25, 2001 (gmt 0)

Did they come back, and if they did, were they very agressive? There are some of those image bots that are just lethal. I had one do 100 requests a minute. That isn't bad if you only have a 100 or so graphics, but this was an archive with 8k graphics and icons...whew.

Son_House




msg:406849
 9:46 am on Mar 27, 2001 (gmt 0)

So far they have not come back.

> There are some of those image bots that are just lethal.
That's what I was thinking as soon as I found out that they were looking for images. Lucky for us, we have fewer than ten and they are small.

volatilegx




msg:406850
 8:14 pm on Mar 27, 2001 (gmt 0)

note: this hostname resolves to 213.242.179.43

I was unable to resolve it directly, but I already had the IP number listed for picsearch and I did a reverse DNS lookup on the IP and the hostname matched.

Dan

psbot




msg:406851
 8:57 am on Apr 4, 2001 (gmt 0)

We at picsearch are still developing our software. We are using a load spread technique to ensure that a domain should not be hit more than once every ten minutes.

The service we will provide will be public and free of charge. We are not "stealing" pictures but merely downloading them to create searchable thumbnails. References to the original picture and the page it was indexed from are always provided with the search results.

www.picsearch.org and www.picsearch.org/bot.html will be updated with more information during the day.

For more information, please contact info@picsearch.org

bobriggs




msg:406852
 4:24 am on Jun 5, 2001 (gmt 0)

217.75.104.26
psbot/0.1 (+http://www.picsearch.org/bot.html)

I noticed a different IP. I can't get on whois.ripe.net now to see who owns that block.

The thing did NOT request robots.txt

bobriggs




msg:406853
 4:59 am on Jun 5, 2001 (gmt 0)

Sorry, 217.75.104.23, did request robots.txt.

I read the FAQ on their site. Anybody know where the 'thumbnails' are used?

psbot




msg:406854
 12:32 pm on Jun 5, 2001 (gmt 0)

In the same manner as most other picture search engines, picsearch will use the thumbnails to provide previews of the search results.

Other questions can be sent to info@picsearch.org.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved