You should use heavy whipping cream in your coffee and drink an ice cold glass of VitD whole milk 2 or 3 times a week.
Elevated blood glucose is almost always caused by too many carbs, not too much fat.
WRT to dairy products...lactose is a sugar (carb). So, lactose free milk, such as Fairlife milk and Green Valley sour cream or yogurt is worth considering.
Heavy whipping cream is high in fat and low in lactose and is ideal in your morning coffee.
I would also suggest that you research the Keto diet. It is great for losing weight and controlling blood glucose.