The jews were not the only group that was specifically targeted for extermination.

Although it is entirely possible that, had it not been for the decision to "find a final solution to the Jewish question", the machinery of extermination would not have been in place for the other groups, who would have just been killed by the conditions of slave labour in the concentration camps.

A society committed to the notion that government is always bad will have bad government. And it doesn't have to be that way. — Paul Krugman

Only Jewish gay men were sent to the death camps. The high death rate of gay men had to do with their low status, not with their being "specifically targeted for extermination." In fact, some gay men won release from the camps ... by agreeing to be castrated and sent to serve in a Penal Regiment, where the death rate wasn't much lower than in the camps. And others were made guinea pigs in barbaric experiments to "cure" them and save their Teutonic genes for the Master Race.

Horrible as the persecution of gay men under the Third Reich was, it does NOT qualify as a Holocaust. Only about 50,000 of Germany's millions of gay men were imprisoned, and, as you point out, less than half of this number died.

I would also argue that the Nazis did not kill "all those [gay men] they could get their hands on." Not only did most German gay men survive the Nazi regime; Nazis never bothered to incarcerate even "known" Slavic homosexuals since there was no "danger" of their damaging the supposedly superior Aryan gene pool.
 

I was a little surprised to see the totals you list did not include non-Polish Slavs and Communists who I believe were slaughtered in fairly high numbers.