Is it not possible that Charles is in agreement
Basically, no.
Charles might prefer not to be King. But his greater desire is that William should be given as much chance as possible to live as close as possible to a normal life before the throne falls to him. Charles will take the crown, even if it's only for a few years, just to spare his son from having to completely subvert his own life to duty a few years longer.