Does my computer need to be on for me to make a call?

Getting Started with VoIP

No, unless you are using a softphone. All you need to call with VoIP is an active broadband internet connection.

(To get an active broadband internet connection for multiple phones, you may need some kind of router in order to get enough Internet connections available for your phone).