That sounds like a case of remote desktop control via a program installed on your computer, such as "GoToMyPC", "TeamView", "Skype", "Hangouts", or similar (there are a bunch of them, some commercial, some freeware). Could even be a remote tech-support thing from some time in the past when you got support from a manufacturer or dealer.
I suggest you crawl through the machine's "Program Files" folders, looking for programs that allow communication between you and someone outside, that include "sharing" a desktop.
If there's nothing like that, you probably got infected with something that's accomplishing that remote control with a trojan of some sort. Get your anti-malware software in gear and scan...