Do we have to carry the Green Card all the time? what if not?

the notice says we need to carry the card all the time, this is the law.
is there any penalty if we don't do that?
i don't think anybody carrying the card just like the driver license.
Thanks.