You should avoid long trip during first three months of pregnancy, otherwise it will be in risk of abortion. The immigration issue seems to be not a problem to you and your hu*****and (even if he wants to apply for a visa), and the critical issue is your baby. Check your doctor but not lawyer before you leave.