Not everyone wants to hang with everyone. The more charisma you have, the more popular you will be. I question how much this is due to people's charisma versus the norm.

Popularity is a factor of charisma and maybe looks. Not much else.