My opinion: Do not screw up the chance. If the first manager does not feel comfortable, the second manager will not cover you too.
Never rush when you are looking for job. Three weeks is not too long. Let the second manager know you are waiting the first manager's final decision for three weeks. But you would be very happy to see him if he can communicate with the first manager.