I ordered a bag of Durian flavored hard candy online a few years ago. The vendor was in Indonesia. It had a unique flavor that was rather good. Whatever ‘stench’ component the fruit may have had was absent in the candy.
If its the same popular candy Im thinking of then you experienced the correct flavor just in a very mild and sweetened form. There are a kind of durian cookies (blonde Oreo w/durian frosting) sold some places that you would rather enjoy. Just opening the lid on the plastic jar it comes in makes the wife scream even though its very mild. I kind of wonder if there isn’t something in it that not everyone can smell and that’s what makes the difference.