You are right! you either have a leak somewhere or a problem with the charcoal canister which adsorbs fuel vapors.
There's a good chance your EVAP system is malfunctioning. although this is usually accompanied by a CEL.
So best to make a service appointment.