Nobody will call him for reference only if you provide his contact info as reference. Nobody has any right to do anything w/o your permission. It is also OK if you complain to HR about your boss before your leaving, it might not do any good to you or any damage to your boss though.