Is it inappropriate to not allow family to attend a teambuilding function?

We are hosting an after hours, weekday event to boost employee morale. We would like to limit attendance to staff only, so that they can interact and teambuild amongst each other. Several have asked if they can bring family members, but I would like to say NO because it may interfere, plus it is too costly to cover all of the additional people. How do I handle this situation?