Ever notice how he plays with his cane handle in that movie? It is as if Houston is saying loudly “HEY, THIS GUY IS AS QUEER AS A THREE DOLLAR BILL!” under the Hays Code.
Yes - that’s what gives it away - apparently Bogart was cracking up when he played it that way.