One of the challenges in wargaming is often buildings shouldn't be the the same scale as figures.
For example, with Napoleonics, a figure in our games = 50 real men. Thus a unit of infantry might be 12 figures that represent 600.
A house needs to be smaller because how many houses can hold 600 men?
We use 15mm buildings (still a little too large) with our 1/72 figures. It looks OK.
Conversely, with skirmish wargaming, buildings should be the same scale.
With our Dark Ages skirmish games, 1 figure = 1 man so buildings need to be at the "correct" size.
donald