Not necessarily. You have a task scheduler on your system, much like Linux cron, and certain tasks can be configured to wake the computer. Often enough your mouse and keyboard are configured to wake the computer from sleep, and if a cat, dog, or wayward critter hit a button or wiggle the mouse, it will wake your machine.
You can go into Windows event viewer > System log, and look for event ID 1 (Power-Troubleshooter) to show you the wake events and what kicked them off.
I am fairly versed in how it works, been into it since the 80s and have NEVER allowed self driving configurations or tasks from any of my computers. When I am not on it I power down and it is down, and after those two events years ago I also make sure and disconnect all possible connections when I power down. I still practice these habits even now with Linux. The remote events were indeed in my logs as not local, someone came in a backdoor and powered it up, and they tried to do it twice before I started my habit of disconnecting everything when I’m not on it.