Welcome to WebmasterWorld Guest from 3.227.208.153

Forum Moderators: martinibuster

Message Too Old, No Replies

Need Deepest Website Crawl Tool

Working reconsideration request, all backlink reports miss links

     
1:50 pm on Sep 5, 2014 (gmt 0)

New User

5+ Year Member

joined:Feb 16, 2011
posts:1
votes: 0


We have a client that acquired some bad links in 2011-2012. In our 2 rounds of reconsideration requests, google has returned 3 link examples of bad links. None of these bad links were on any backlink reports we assembled from:

-ahrefs
-majestic's fresh+historic
-webmaster tools
-bing webmaster tools
-open site explorer
-webmeup

I am surprised majestic was missing links in a full report.

There are still links out there we cannot find. Am I missing some tool out there that has more data than Majestic?
4:59 pm on Sept 5, 2014 (gmt 0)

Preferred Member from GB 

10+ Year Member Top Contributors Of The Month

joined:July 25, 2005
posts:406
votes: 17


I am surprised majestic was missing links in a full report


Majestic honours the robots.txt protocol. So if sites block its bot, it won't crawl the site. Also, Majestic, although one of the best SEO tools ever, is sometimes missing the small sites residing in the deep realms of black-hat world.

There is one major tool your list is missing. If you google for
backlink tool
it will be there on the 1st or 2nd page depending on which country you're googling for.

BUT


There is a chance adding another tool won't help you discover more links because, strength-wise, they're all pretty similar.

In fact, I am surprised you're having to go through this because I usually find it's enough to combine Majestic, OSE and GWT.

One thing you can do, though, is search for your links using some advanced search queries... that is if the site's link acquisition efforts have footprints. I bet you'll find footprints.

For example, if the previous SEO guy concentrated on building "forum profile links" and used a certain set of anchor texts, you'd search for:

"buy green widgets" inurl:"space.php?uid"
or
"buy green widgets" inurl:member.php


depending on which forum software is used on the spam sites.

If they've concentrated on doing link exchanges, you'd search for:
"buy green widgets" inurl:links.html
or
"buy green widgets" "exchange links"


and so on...

Mind you, this only works if your keyword combinations or link description text are sort of unique. If it's just a one-word anchor text or something very popular, you won't get much out of this method. But I've had success with this method in narrow niches.

Also, something to consider. Maybe you simply have to "work" your current toxic link list better. Maybe Google thinks you haven't quite proved you've put enough time and effort in the whole link removal procedure.
5:02 pm on Sept 5, 2014 (gmt 0)

Preferred Member from GB 

10+ Year Member Top Contributors Of The Month

joined:July 25, 2005
posts:406
votes: 17


btw congratulations on your first post. 3 years of lurking and finally you've pushed the "Submit" button :)
5:12 pm on Sept 5, 2014 (gmt 0)

Moderator This Forum from US 

WebmasterWorld Administrator martinibuster is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Apr 13, 2002
posts:14938
votes: 495


Eric Enge published an article [webmasterworld.com] last year where he estimated that all the backlink checkers report between 30-50% of actual backlinks. All of the backlink tools are incomplete. Perhaps they're more complete for some sites than others. But they're still incomplete.

I agree with adder, it might be useful to do some advanced searching, what I call Search Segmentation.