You should definitely clearify things with your manager first

Let him to make clear you own the project or you both co-own the project. It's a matter of who's responsible for it.
If it's you, you should let your co-worker know that you're welcome his suggestions, but your make the final decision. You can add him as optional to your meetings if he's that interested in your project.