Forum Moderators: open

Message Too Old, No Replies

Yahoo MSN Correlation

Why do we go up/down in one and same in other?

         

nuevojefe

9:07 am on Aug 9, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



What's the deal with MSN and Yahoo? We have one site that we are working on that was #7 on Y! and #4 on MSN for a certain phrase then it dropped to #66 on Y! and 107 on MSN.

Few days later went back up to #7 on Y! and back to #4 on MSN a day or two later, then dropped back down on MSN and after another two days it dropped back to #66 on Y!.

Then for about a week it stayed at it's low position only changing from #66 to #65 on Y.

Yesterday it shot up to #2 on Y! and number 3 on MSN. We're working on it of course but nothing so severe that it should cause a 60/100 position shift.

Why do these two engines seem to correlate so much?

DaveAtIFG

3:07 pm on Aug 9, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Perhaps it has to do with Yahoo owning Inktomi. YST is reportedly a new engine built from various acqusitions and based on the Ink data.

MSN still uses Ink data AFAIK, but they're actively spidering. Who knows what their beta is using? ;)

nuevojefe

9:52 am on Aug 10, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks Dave. So most sites doing well on Y! should do well on MSN?

DaveAtIFG

2:36 pm on Aug 10, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Generally speaking, for now. Recall that SERPs based on Ink data were always "customized" by/for Ink customers.

Because YST is new (still being refined) and MSN is spidering, I expect their SERPs to diverge a good deal, and soon.

nativenewyorker

10:35 pm on Aug 10, 2004 (gmt 0)

10+ Year Member



There have been some very bizarre changes in Y! / MSN serps over the last couple of days. A significant change I noticed today for the top 20 results of both engines is the inclusion of vastly inferior pages. It appears that there are many more pages included from free hosting sites including Geocities, Tripod, ISP homepages, etc. Anyone else notice this in their categories?

Adam_C

10:54 pm on Aug 10, 2004 (gmt 0)

10+ Year Member



MSN still uses Ink data

Are you saying that Inktomi still exists as a separate entity to Yahoo?

Or that the MSN index is now based on a combination of Ink and MSNbot spidered content?

I thought that MSN was using more or less the same data as Y! but as always, applying their own algorithms, geo-targetting and so on.

nuevojefe

2:12 am on Aug 11, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Because YST is new (still being refined) and MSN is spidering, I expect their SERPs to diverge a good deal, and soon.

I'm thinking the same thing but I'm not so sure it will be too soon.

I hadn't been paying enough attention (my bad) to MSN (for a LONG time) and wasn't really aware of where/how they were pulling data; so thanks guys for sharing some info.

So what're your best guesses/known facts as far as what percent of MSN's current (not techpreview.search.msn.com) search data is supplied from who/where?

We always did pretty well on MSN building pages for Ink and Optimizing for G and never worried too much. But dropping from the first pages definitely made a noticeable difference in revenue for a site that's still semi-lagged (sandboxed at G).

Greatful for whatever info's shareable but not too worried since the new beta search has us everywhere we want to be across 90% of our sites. That's not to say the results are that great ;-)

DaveAtIFG

4:41 am on Aug 11, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



but I'm not so sure it will be too soon
I'm betting Yahoo gave MSN a year from the time of Ink acquisition (Sept or Oct '03?) to find an alternate data source. AFAIK, MSN is the only remaining Ink customer of significance.

what percent of MSN's current search data
My GUESS is that free search is 100% Ink. Like you, I haven't paid much attention for several years.

nuevojefe

7:01 pm on Aug 11, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Ah, good reasoning about the year...

Like you, I haven't paid much attention for several years.

Glad to know there's other in-they-loop types that are out of the loop on this one. :-)

Thanks for the input DaveAtIFG

your_store

7:30 pm on Aug 11, 2004 (gmt 0)

10+ Year Member



My GUESS is that free search is 100% Ink
While I don't have a definite answer, I know it isn't all Ink. MSN seems to selectively include urls that have been indexed by Y's free crawler. How they decide which urls make the cut is anyone's guess.

I was also under the impression that MSN had recently pulled all paid advertsing from their SERPs, Ink & Sitematch included. I tried to dig up the thread here, but of course I didn't bookmark it.

nuevojefe

9:17 am on Aug 15, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It seems to me that in the few SERPs i watch in MSN and Y! they keep shifting back and forth from old data to new.

I wish I knew how old because certain sites aren't affected (Ours is new). It will be like 18 of top 20 don't move (except to fill in gaps) but two disappear then later or a few days later they reappear.

HarryM

11:42 am on Aug 15, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Both MSN bot and Yahoo! Slurp visit my site regularly, but until two days ago only a few of my pages could be found in either index. I believe this to have been due to being excluded from the free search because I once had an Inktomi PFI page.

Presumably this exclusion has been lifted because on August 13th most of my pages appeared in both MSN and Yahoo serps and I now have traffic from both. I assume from this that MSN is still getting its feed from Yahoo.

However although a keyword search brings up my pages in both serps, a www.mydomain.com search displays most of my pages in Yahoo but only 2 in MSN - which is odd.

markd

3:03 pm on Aug 23, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Harry

Are you saying that if a site had a page in the old Ink PFI then the whole site would be excluded when submitting a page 'for free' via the new Yahoo?

Marval

5:28 pm on Aug 23, 2004 (gmt 0)

10+ Year Member



markd - that has been my experience

nuevojefe

8:30 pm on Aug 23, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



That's odd. We've seen sites that were included in Ink PFI performing really well. Better in fact than similar sites that should do equally well or better but weren't PFI'd.

HarryM

11:38 pm on Aug 23, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



markd,

I originally had 2 Inktomi PFI pages (out of about 500). When Yahoo took over Inktomi all my Yahoo traffic disappeared except for the 2 Inktomi pages. Even after one page had expired and I cancelled the other I still got no traffic. Slurp visited regularly, so I wasn't banned.

Then suddenly the traffic returned. Personally I think this was a glitch in the Yahoo system which has now been fixed, or at least for me.

2_much

12:39 am on Aug 26, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



This is a great topic to explore.

I've yet to find any reasons why MSN excludes/includes certain data.

I have a tool that visually compares the 2 SERP's, but when I investigate, I can't find any actual correlations.

Also, the other part is that it's hard to determine how much of their own crawler data is being included into Yahoo's feed. Are they entirely separate databases? Or are they being combined?

I would guess they are entirely separate, but then, how are some added and some removed from MSN"s SERP's?

This would be very helpful to explore.