Nah it’s contrived.
It’s an impossible accusation to disprove, because it’s not a thing you did, it’s your preference. You can only “protest too much” or “protest too little”.
Likely the other person wants the relationship to end, but can’t stand the idea of it being their fault. So it’s the “closeted” person’s fault.
The straights are not doing well