change horses in midstream
To change one's plan or approach when an effort is already underway or at another inopportune time.
Often used as a caution: "don't change horses in midstream".
-
1975, Bob Dylan (lyrics and music), “You're a Big Girl Now”, in Blood on the Tracks:
A change in the weather is known to be extreme / But what's the sense of changing horses in midstream ?