For each computer being able to access internet:

You have to use a router. If the ports on the router is to enough, you can connect to switch to one of the port to extend.
You can use static IP. However, use dynamic IP will be much each for you.