Those will all factor. If you're trying to sell widgets in America and your server is in Europe then to me that would seem a bit fishy though maybe a little less so from countries not notorious for online criminal activities.
If I was a search engine trying to help people find widgets I'd want to avoid sending them to a source that might charge them international shipping. I think it would require a human review on Google's part to know better...and how often has that been reported as happening in any circumstance here on the forums? I personally would give the thumbs down if I were at Google to waste time doing manual reviews for sites which the countries don't match, that would definitely be something the webmaster knows inherently.
You should stick to a server in the same country that you're selling your products and services.