Is this really being "phobic"?

No, I don't think you're phobic, he just sounds very annoying :/ I'm gay and I would find that annoying as well. Good for him that he's happy with who he is now, but he doesn't need to shove it in people's faces all the time.