Forum Moderators: open
www._w_h_o_i_s_.sc
Mozilla/5.0 (Windows; U; Windows NT 5.1; en; rv:1.9.0.13) Gecko/2009073022 Firefox/3.5.2 (.NET CLR 3.5.30729) SurveyBot/2.3 (D_o_m_a_i_n_T_o_o_l_s)
robots.txt? Yes.
BUT -- it's more than ignored.
For example, they've recently revamped their WHOIS info and still include the ENTIRE text content of a site's home page, in spite of robots.txt, NOARCHIVE, etc. And where 403'd, they include the ENTIRE text content of that page, too. But while your content info, what they call "SEO Text Browser", was less prominent before, now your stuff gets a tab and basically an entire page pop-up.
We've talked about this gang before, how they're also D_o_m_a_i_n_T_o_o_l_s and N_a_m_e_I_n_t_e_l_l_i_g_e_n_c_e; how they're connected to eNom, and NameJet and do assorted SEO stuff; how they're also related to Aboutus.org, a site that also republishes copyrighted material without permission and, thus far, with impunity.
For example, in Jan., 2008, our own IncrediBILL posted "Domain Tools Exposed [webmasterworld.com]" here on WW.
So, about D_o_m_a_i_n_T_o_o_l_s et al republishing your copyrighted content, obtained through ignoring (at least my sites') robots.txt, apparently via the UA indicated above.
Check it out --
Swap one of your sites' names into the following URL's "yoursite.com" spot:
http
[/code]://w h o i s._d_o_m_a_i_n_t_o_o_l_s_.com/seo-browser/?domain=yoursite.comAnd if you check a bunch of your sites through their base URL or --
http[code]
-- your logs will show you using you UA coming but from their IP, w/ a technically fake ref. So let's say on your site, again a.k.a. yoursite.com, your visit via D_o_m_a_i_n_T_o_o_l_s's site looks like:
IP (no rDNS): 66.249.16.2nn
UA: Yours
URI (root): /
REF (fake): http[code][/code]://w h o i s._d_o_m_a_i_n_t_o_o_l_s_.com/yoursite.com
Doggoneit.
This is what I have personally decided for the sites I manage:
DT(d_o_m_a_i_n_t_o_o_l_s) usually coming up for domainName searches in SERP when someone is looking for my domains by name. What I do is make sure is try to get Other sites to rank for that term, the ones that only point to my direction from the first page on SE and then I let it be on Autopilot.
And Yes 66.249.16.#*$! is Banned at the root, not even txt.stobor if I spell it correctly.
I wouldn't call them a Gang, they are just trying to make a Buck on the larger Scale of ignoring Webmasters that Care.
try this: Read the contents of you FAVICON and spit it back in BINARY. SEs should Tank pages that contain gibberish stuff on pages. Just an observation.
T_e_l_l_m_e_a_b_o_u_t_i_t_:_) I just wanted to report the details but got no love from WW's program w/o 'em. (Spaces were too spacey.)
"try this: Read the contents of you FAVICON and spit it back in BINARY..."
Now I must be too spacey. Explain how-to and where-to, please? Thanks! -iufP
