Coming Out As Polyamorous

Many polyamorous people, those who are in concurrent relationships with multiple partners, experience shame and intolerance. Why is non-monogamy between consenting adults perceived as a dirty little secret?