If I run a vpn on it then the Googled OS may still know my location(from wifi and bluethooth scanning that it may be doing nonstop)
The VPN has nothing to do with your phone's location settings.
would the vpn only mask my activity from my internet service provider?
Yes, plus it's a shared server so it makes it harder for websites to know your location or to track your activities across sites.