Yes, it does. But it is only one of the many potential red flags. There are many valid orders that request/require a different billing/shipping address, so you'll be throwing away good sales if you don't allow it.
I'd say the usability/fraud balance is tilted heavily towards allowing shipping to addresses other than the billing address.
About 30% of my holiday orders are shipped to a place other than the billing address.