Hi @Loginname,
You can choose the locale (language and some extra details) configuration as you want.
If you don't have the language package, the store will be shown in English (en_US).
If you want to delete the stores views, you can do that from System -> Manage Stores.
(Please, make a backup before perform those tasks).
I didn't found complete Norwegian packages for Magento 1. Maybe you should try to be in touch with some local agency or developer.
If not, maybe this could help: https://github.com/versedi/Magento-Locales
Then, there are some free plugins that shows the Google Translate widget to your store (but since the store will be showed in english maybe you don't need it).
If you still want to use that solution maybe you can check the Magento's Marketplace: https://marketplace.magento.com/catalogsearch/result/?q=google%20translate#q=translate&idx=m2_cloud_...
I didn't found anything right now (but I know there are options). I got a old free module published on GitHub that allows you to do somehting like this:
Set the translator widget
Translate the store using Google Translate