If you work for an employer who doesn't withhold Social Security taxes from your salary, any retirement or disability pension you get from that work can reduce your Social Security benefits.