as long as you are not actively bringing current clients with you/do not intend to approach your current clients after you change the job, don't see a problem here.