If you change the hosting at the same time as the domain transfer, there can be downtime if you have not planned for the gradual transfer of traffic from the old server to the new. Even for a hosting change, most downtime can be mitigated of eliminated entirely.