Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000

Namerimi Nutch Spider

8:41 pm on Dec 27, 2018 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
votes: 739

UA: Namerimi Nutch Spider/Nutch-1.15
IP: may be distributed; to date seen from 54.154.229 and 63.33.202
robots.txt: yes

Like most Nutch robots, it has humanoid headers.

Pattern of requests--selected interior pages, many of them in a single directory--suggests it is getting a shopping list from somewhere else.

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members