UNjoining a group

I am thinking of dropping out of some inactive groups (.e., groups that have not had any entry in months).  With each group, there is a button for joining the group, but not for UNjoining the group.  How do you UNjoin a group?