I'm a native English speaker from the UK, and definitely use which/that interchangeably, basically reducing it to a stylistic choice. I thought about it a lot and thought "maybe 'that' does imply more important information than 'which'..." but then I realised if I substituted 'which' into those sentences, it had very much the same effect for me.
Looking at the example about the office
Our office, which has two lunchrooms, is located in Cincinnati.
Our office that has two lunchrooms is located in Cincinnati.
Without context, I agree that the implications of the sentences are slightly different. However, if you remove the commas (and many people do leave them out!), they seem to have exactly the same meaning to me.
Our office which has two lunchrooms is located in Cincinnati.
Our office that has two lunchrooms is located in Cincinnati.