Does your heater has the same problem? Symptom of a bad blower motor resistor is usually the AC/heater blower will only work on high. Certainly there's also posibility that resistor is ok but the connector to it is bad(loose connection).
There was detailed DIY instructions for an old Camry by a handyman at this forum a while ago.