Go start work in the new place as long as they are OK

As long as you knew you are good and clean, there is nothing to worry about.
As long as the new company say you can go ahead to start, go start work for them.

You shouldn't let the current company knew you are going to change job unless you tell them you are resign after two weeks.

Thanks!