If you are not considered a resident in Country A, you will not have to pay taxes on your foreign income. If you are residing in Country A, you will typically pay taxes on your foreign income. However, you may not have to do it if your permanent home ('domicile') is abroad.