I've been to most of the places I write about - with one exception: Russia. But my wife taught there as part of an EU sponsored program(me) and made long-lasting friendships with a couple of young Russians. One of them read the Russian chapters as I wrote them and vetted them for all kinds of things : from the doorkeys to certain Russian hotels, to street desciptions, and most importantly - to the way Russians interact, the way to approach them, the credibility of dialogue, etc ...
Where I've been unable to do this I have done tons of research about a place and its people knowing that I'll probably only use a little of it... but the little that I do use is used with confidence ...
Haven't you read any stories or novels where the event/action took place where you lived and you didn't recognize it. Recently I read one of James Patterson's novels set in Maam Cross here in Connemara in the west of Ireland where I live these days. Well, you wouldn't recognize the place in the book. If you expected to visit here and were to look for the Maam Cross described in Patterson's book, you wouldn't find it.
What do you think? Does it matter if you don't get it right?