Not every homebuyer wants the biggest house on the block.