It may be perfectly within your authority to execute such a deed, but because there is the appearance of conflict of interest (which is why you raised the issue in the first place), the best course of action remains to recuse yourself in a situation like this.
In other words, if the deed can be done properly, there is always a way to do it without compromising your principle (even in appearance only).