The most recent solar maximum only entailed about 100 sunspots. There have been cycles where the minimum count was not much less than the current maximum.
If the solar cycle does affect the weather, it appears that the current trend portends an extended cooling off period.