Welcome to WebmasterWorld Guest from 34.203.28.212

Forum Moderators: Ocean10000

Namerimi Nutch Spider

     
8:41 pm on Dec 27, 2018 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:15450
votes: 739


UA: Namerimi Nutch Spider/Nutch-1.15
IP: may be distributed; to date seen from 54.154.229 and 63.33.202
robots.txt: yes

Like most Nutch robots, it has humanoid headers.

Pattern of requests--selected interior pages, many of them in a single directory--suggests it is getting a shopping list from somewhere else.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members