homepage Welcome to WebmasterWorld Guest from 50.19.169.37
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
ixquick, duckduckgo, startpage
IP ranges of these search engines
motorhaven




msg:4587168
 4:16 pm on Jun 24, 2013 (gmt 0)

Does anyone have a list of ip ranges for ixquick, duckduckgo and startpage?

Recently these are starting to get attention due to the whole NSA scandel and I want to make sure the server farm blocks I have in place aren't inadvertently blocking them.

Tried searching this site but all the "I used ixquick to find" posts have polluted the results so badly I can't find anything useful. "startpage" obviously returns a ton of stuff about people's home pages!

 

phranque




msg:4587244
 7:37 pm on Jun 24, 2013 (gmt 0)

http://duckduckgo.com/duckduckbot [duckduckgo.com]:
72.94.249.34
72.94.249.35
72.94.249.36
72.94.249.37
72.94.249.38


ixquick and startpage are one and the same - they are "meta search engines" which means they don't do any crawling themselves as they are aggregating other search results.

not2easy




msg:4587255
 8:13 pm on Jun 24, 2013 (gmt 0)

Ixquick and startpage are the same company, they do not run any bots, they "digest" other search engines' results including Google's. Duckduckgo uses Yandex results though they crawl too. Startpage is the US version. Ixquick has the more useful results IMHO - they offer ways to use Google features without using Google.

wilderness




msg:4587263
 8:42 pm on Jun 24, 2013 (gmt 0)

duckduckgo will show up if you run tracerts.

motorhaven




msg:4587283
 10:40 pm on Jun 24, 2013 (gmt 0)

Thanks all. I ran traceroutes on both, problem is that I was not certain if their crawling IPs were different thank what I get through traceroute.

Going to check my firewall and web logs now to make sure they aren't blocked.

Any other up and comers I'm missing in the privacy search field?

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved