Affidavit can be used to apply for something, such as green card, a patent, a license. Affidavit generally cannot be used to convict someone, or in this case, suspend someone's professional licence. Here is why
http://en.wikipedia.org/wiki/Confrontation_Clause
The Confrontation Clause of the Sixth Amendment to the United States Constitution provides that "in all criminal prosecutions, the accused shall enjoy the right…to be confronted with the witnesses against him." Generally, the right is to have a face-to-face confrontation with witnesses who are offering testimonial evidence against the accused in the form of cross-examination during a trial.
Of course this is not a criminal trial, but generally they use the same rules because defedant WILL APPEAL if rules are lax.