Hello Khama,
I don't know for Panther, but on Tiger server, you are able to restrict the use of the VPN (on the client machine) to a defined network. You need to use Server Admin, select the server with VPN, go to VPN section -> settings.
The fourth tab to the right (Information on clients)...