Its not the same thing.It's like when they said allowing gay marriage would somehow damage the institution of marriage. The world isn't going to fall apart because your child may compete against a transgender child.
Its a sports issue, and scientifically speaking, some athletes would have an unfair advantage based on their birth gender, or the taking of supplements that would be banned for any other athlete.