I am doing this now, and I do not have the marriage certificate and birth certificate.
If your spouse has the visa already, it is issued on the base that you're marriage couple, I suppose.
I am now using the utility bill to show we are living together.
There are birthdays on passports, so I am not bothered by birth certificates.