Unsure of what to do?

I'm a really not that much of an outspoken person, but i've talked to my husband and he agrees, but we have a huge family on both sides, (my side there are 9 people and his side their are 7 people)(all are immediate family) and to me that just seems like too many people to come up to the hospital while i'm in labor and just too many people to come in the room right after i give birth, so i was just wanting my parents and his parents to be there the day of and have everyone else come the next day or something, i don't wanna hurt anyone's feelings or anything but its too overwhelming for me especially after something like that.... but my question is how do i tell everyone not come without stepping on toes or should i just call our parents and not call anyone else until the next day, please any help would be great. PLEASE!!!! i'm really stressing out over this!