I had this situation once. Actually the hiring manager had a phone interview with me and told me to set up an on-site interview with HR while he was travelling. He told me it's OK without him. I did not get the offer and I think no one wanted to make the decision except the hiring manager.