homepage Welcome to WebmasterWorld Guest from 23.22.173.58
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
psbot/0.1
picsearch is currently indexing pictures
Son_House

10+ Year Member



 
Msg#: 425 posted 8:50 am on Mar 3, 2001 (gmt 0)

Here is a new one that hit our site yesterday. They are looking for pictures. Went to the site but it is not open for business yet. They are from Sweden. The only thing it requested so far was robots.txt. I'm going to add them to it as soon as I finish here.

ps.direct2internet.com - - [02/Mar/2001:13:06:41 -0500] "GET /robots.txt HTTP/1.0" 200 1800 "-" "psbot/0.1 (+http://www.picsearch.org/bot.html)"

[picsearch.org...]

 

Brett_Tabke

WebmasterWorld Administrator brett_tabke us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 425 posted 9:29 am on Mar 25, 2001 (gmt 0)

Did they come back, and if they did, were they very agressive? There are some of those image bots that are just lethal. I had one do 100 requests a minute. That isn't bad if you only have a 100 or so graphics, but this was an archive with 8k graphics and icons...whew.

Son_House

10+ Year Member



 
Msg#: 425 posted 9:46 am on Mar 27, 2001 (gmt 0)

So far they have not come back.

> There are some of those image bots that are just lethal.
That's what I was thinking as soon as I found out that they were looking for images. Lucky for us, we have fewer than ten and they are small.

volatilegx

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 425 posted 8:14 pm on Mar 27, 2001 (gmt 0)

note: this hostname resolves to 213.242.179.43

I was unable to resolve it directly, but I already had the IP number listed for picsearch and I did a reverse DNS lookup on the IP and the hostname matched.

Dan

psbot

10+ Year Member



 
Msg#: 425 posted 8:57 am on Apr 4, 2001 (gmt 0)

We at picsearch are still developing our software. We are using a load spread technique to ensure that a domain should not be hit more than once every ten minutes.

The service we will provide will be public and free of charge. We are not "stealing" pictures but merely downloading them to create searchable thumbnails. References to the original picture and the page it was indexed from are always provided with the search results.

www.picsearch.org and www.picsearch.org/bot.html will be updated with more information during the day.

For more information, please contact info@picsearch.org

bobriggs

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 425 posted 4:24 am on Jun 5, 2001 (gmt 0)

217.75.104.26
psbot/0.1 (+http://www.picsearch.org/bot.html)

I noticed a different IP. I can't get on whois.ripe.net now to see who owns that block.

The thing did NOT request robots.txt

bobriggs

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 425 posted 4:59 am on Jun 5, 2001 (gmt 0)

Sorry, 217.75.104.23, did request robots.txt.

I read the FAQ on their site. Anybody know where the 'thumbnails' are used?

psbot

10+ Year Member



 
Msg#: 425 posted 12:32 pm on Jun 5, 2001 (gmt 0)

In the same manner as most other picture search engines, picsearch will use the thumbnails to provide previews of the search results.

Other questions can be sent to info@picsearch.org.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved