Forum Moderators: mack
This is not the only case I have seen like this, but it is a prime example.
I think the higher your PR, the deeper it will index but I sure can't tell because it never goes very deep.
MSN bot spiders way deeper but doesn't index the deeper pages either.
This is a joke, right? I can't get them to even include my index page in their serps even though the bot has found it weeks ago and is indexed as often as two times a day--and it was listed high for a while in the serps, now it's gone. The only ones I see doing a decent job these days are Yahoo and Google.I never though I would say a kind thing about Google but it is clear they know what they are doing when it comes to indexing.
MSNs new technology bot is far, far better at indexing. Googlebot on the other hand takes information and then does nothing with it in the SERPS.
Also, MSN bot is going deeper into sites, FACT "
Just because you say it is a fact does not make it so. If that were the case, they would have more results for my sites: Site:search, and they don't, not even close. Google has three times as many, and it's not like I even like google, just giving the true facts, Msn is the worst of the big three SEs and is getting worse every time I look at it.
I think they use a dart board to pick ranking, it makes mose sense then most of the stuff I have read on this board, That is one SE that sould have stayed off-line until they get it fixed.
> If that were the case, they would have more results for my sites [...]
Ah yes, sounds familiar - the old "Search Engine X stinks because I'm not top of the SERPs and my whole site isn't in the index" complaint.
And of course it couldn't have anything to do with the complainee's site, it's always the search engine's fault.
Before I offer it, please correct me if I'm wrong...
You have how many websites?
NO I DON'T RANK WELL, JUST BETTER THEN I DO IN GOOGLE. BUT NOT NEARLY AS WELL AS I DO IN A SE OF TRUE QUALITY--- (YAHOO), THEY ARE GOOD BECAUSE THEY BASE THEIR RANKING ON RELEVANCY, THAT IS WHAT SHOULD MATTER, NOT HOW MANY LINK EXCHANGES YOU ARRANGE, OR PRODUCE FOR YOURSELF, WHICH I THINK HAPPENS A LOT.
>"You rank poorly in Google for the pages they have indexed. "
BECAUSE I DON'T SOLICIT LINKS, OR RUN A LINKS FARM,
>Your site is weeks old. (How many?)
16 MONTHS AND WHY SHOULD THIS MATTER?
>You use no black or gray-hat SEO techniques.
NO I DON'T, AND THIS INCLUDES TRADING LINKS AND LOADING UP THE NUMBER OF PAGES TO INCREASE LIKELIHOOD OF GETTING LISTED--THE LAST TWO ARE, IN MHO, WHAT IS WRONG WITH THE WEB IN GENERAL, AND GOOGLE IN PARTICULAR
>"Since MSN doesn't return your homepage in the SERPs, it's the "worst SE," and that is the basis of your complaint.
NO, THEY ARE THE WORST BECAUSE THEY SIMPLY ARE, YOU NEED ONLY LOOK BEYOND YOUR SUCCESS WITH THEM TO SEE THIS, THE DART BOARD THEORY IS WHAT I THINK BEST DESCRIBES THE WAY IN WHICH THEY RANK, IT HAS NOTHING TO DO WITH THE SITE'S REVERENCE OR THE OVERALL QUALITY OF THE SITE
>"Since MSN doesn't return your homepage, it can't be deep-crawling others' sites, despite the evidence."
NOT SHOWING AN INDEX PAGE IS JUST PLAIN STUPID, IF THEY CAN'T DEEP CRAWL HOW CAN THEY BE GETTING GOOD RESULTS? WHO'S EVIDENCE, FROM WHAT I READ, THEY ARE NOT DEEP-CRAWLING
>"You have how many websites? "
THIS IS OF NO RELEVANCE, I BASE MY OPINION ON AN OVERVIEW OF THE RESULTS FOR ALL SITE SEARCHES, UNLIKE YOU, WHO MUST BE (FOR NOW) RANKING WELL IN THEIR SERPS.
From what I can tell, they go by your link popularity which tells them how deep to go into your site.
If other pages link to your internal pages it will index those pages. Otherwise it will just index so deep according to the amount of links pointing to your home page.
They are basically trying to be like google and calculate the odds of a surfer stumbling onto your page. The better the odds (More links pointing to a page) the higher that single page will rank.
If going to your home page is the only way to get to your internal page that is 6 levels deep into your site (Takes 6 clicks to get to it) then MSN bot will spider it but not index it.
I was excited at first when I seen MSNBot spidering so deep in my sites but now I see what's really going on.
Their suggestion was to create a site map. Go figure?
I found a better way and in theory it should work even better than a site map.
I have 5 different sites that are structured exactly the same with different content. But I can link my internal pages of the other sites to the internal pages of this site.
I figure I can link to 2 other sites pages from one page and do it without cross linking the internal pages which will cause 2 links from other websites pages to link to every page on the one site.
It's my "external internal linking theory"!
In plain english...
All of the internal pages of site A would link to all of the internal pages of sites B and C.
B would link to C and D
C would link to D and E
D would link to E and F
F would link to F and A
A would link to B and C
etc...
This would create 2 external pages linking to all of my internal pages of all my 5 sites.
Does it make any sense?
I can't get them to even include my index page in their serps even though the bot has found it weeks ago and is indexed as often as two times a day
I'll explain what has happened to my site and it may make more sense:
1) MSN crawls the pages repeatedly but I can never find these pages in the search by entering a search term
2) The pages CAN be found only by searching on the domain name
3) Weeks later (months from when the beta was probably first released to the public) some pages can now be searched upon.
It appears that they index the pages separately from indexing the content of the pages or from building a dictionary list of terms on your page.
The fact that it is crawling does appear that your site will be listed, eventually.