Why do people think I'm gay just because I don't want children?

I had a vasectomy. Also I don't believe in marriage. It sounds to me like I'm just sensible, and I don't see what the connection between being child free and gay is?