In that configuration you can use either; it really doesn't matter. If I were you I'd use my server IP# for the users that don't need SSL. That way you can save your one extra IP# (don't leave it as shared once you remove all users from it) and use it later if one of your clients needs static IP# for SSL.
Jeff