You did the right thing, even the interviewer were dressing casu

 

dressed properly for the interview, that means you take this position seriously.

In terms of Big Four, I'd think you definitely should wear suits for interview, pencil skirt should work.