Fair housing act makes it illegal to deny housing or charge more based on having children.

Senior aged restricted housing is legal because seniors vote. The exception is a different law and explicitly makes it okay.