homepage Welcome to WebmasterWorld Guest from 54.167.182.201
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
ixquick, duckduckgo, startpage
IP ranges of these search engines
motorhaven

10+ Year Member



 
Msg#: 4587166 posted 4:16 pm on Jun 24, 2013 (gmt 0)

Does anyone have a list of ip ranges for ixquick, duckduckgo and startpage?

Recently these are starting to get attention due to the whole NSA scandel and I want to make sure the server farm blocks I have in place aren't inadvertently blocking them.

Tried searching this site but all the "I used ixquick to find" posts have polluted the results so badly I can't find anything useful. "startpage" obviously returns a ton of stuff about people's home pages!

 

phranque

WebmasterWorld Administrator phranque us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4587166 posted 7:37 pm on Jun 24, 2013 (gmt 0)

http://duckduckgo.com/duckduckbot [duckduckgo.com]:
72.94.249.34
72.94.249.35
72.94.249.36
72.94.249.37
72.94.249.38


ixquick and startpage are one and the same - they are "meta search engines" which means they don't do any crawling themselves as they are aggregating other search results.

not2easy

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month



 
Msg#: 4587166 posted 8:13 pm on Jun 24, 2013 (gmt 0)

Ixquick and startpage are the same company, they do not run any bots, they "digest" other search engines' results including Google's. Duckduckgo uses Yandex results though they crawl too. Startpage is the US version. Ixquick has the more useful results IMHO - they offer ways to use Google features without using Google.

wilderness

WebmasterWorld Senior Member wilderness us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4587166 posted 8:42 pm on Jun 24, 2013 (gmt 0)

duckduckgo will show up if you run tracerts.

motorhaven

10+ Year Member



 
Msg#: 4587166 posted 10:40 pm on Jun 24, 2013 (gmt 0)

Thanks all. I ran traceroutes on both, problem is that I was not certain if their crawling IPs were different thank what I get through traceroute.

Going to check my firewall and web logs now to make sure they aren't blocked.

Any other up and comers I'm missing in the privacy search field?

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved