I lived in the Netherlands for several years, and made mostly local, Dutch friends. Want to know the secret? I learned the language.
You say you have been here for 3 years, yet you are writing all of this in English. For a Dutchman, Norwegian is honestly not that difficult. You'll be amazed at how differently people will treat you if you make an effort.
Veel succes!