You can go to another city for the rest 4 days.
We took highspeed train from Barcelona to Madrid, and it was good.
Madrid: we stayed downtown B&B apartment, very nice and close to everything.
Barcelona: also a B&B, not as nice. But the neibourhood feels safe.