Well there is also garage, driveway, front yard and side yard. Also wall has thickness.
I usually look at the rear setback. I don't think any $2M+ home should have less than a 20 ft setback, but clearly plenty of wealthy buyers disagree...
I would rather have a L-shaped floor plan than a 12ft...