Membership approval for my private group is being byped somehow?

When you, as the moderator, invite people, they are considered pre-approved. They can join right from the invitation. It's when people do not have an invitation and they just click the "Join this Group" on that you have to approve them. So, before you send an invitation, make sure you really would like the person in the group.