That giving people rights does not remove your rights. You don't get a free right to suppress people who are not like you.
BuT I dOn'T wAnT gAyS tO mArRy... Then don't marry someone of your gender. You can still freely stay married to your opposite gendered spouse. It isn't infringing on your rights. It bugs you that you can't force other people to do what you want.