[Mr.FixIt]

...probably taste fishy, as all they eat are fish and shrimp. I would reckon, they are the food of last resort.

I don't know, ribeyes don't taste like hay.

[AZJeep]

Andrew Zimmern always said that animals often taste like what they eat.
Steaks taste like grain, as most choice meats are grain fed. Hay, I guess, is taste neutral.
It is my experience, that most water animals, like otters, frogs, snakes etc. taste fishy.
I have never tasted penguin, and have never heard anybody tasting it and describing the taste. So my guess would be some kind of oily, fishy taste, maybe like an eel.
I have tasted eel. It was served to me like an expensive delicacy. I hated it, but had to pretend to like it!