You will likely want to set your ground face and all the building faces as no-slip walls.
Then, when you look at your wind magnitude slices, make sure that your lowest slice is 1/2 meter or so above ground level, I think things will make more sense at that point…