Low housing inventory has created competition between millennials, who are in their peak home-buying years, and boomers, who may be downsizing or buying second homes.