Router should list the names, but

Depending on what kind of router you have and what kind of IP phone.
For example, Vonage doesn't really have an IP for the phone, it directly use the routers, the router have 2 phone ports.