Could happen, but not likely. Our PC fighter jocks are very professional. The problem lies in spatial reference. Its very difficult to assess depth and spatial references on monitors.
In addition, there is no true "peripheral" vision when flying electronically. The cells that control our peripheral vision are much more sensitive than our focused vision.
On top of this you are dealing with a limited view. Usually limited to the direction a camera is pointing in. If you have the camera view focused in a direction divergent from the direction of the aircraft, it can be horrendeously disorienting.
Most of these guys are x fighter jocks, super-professionals, and concentrate intently. So I wouldn't be suprised to see them reaching for the ejection handles under their office chairs when they loose control of one of these UAVs.
That may be true for the current generation of PC fighter jocks. . . but the next generation are currently playing Unreal Tournament, Prey, and similar. . .
The reflexes for computer flight are different from that of physical flight.
And the days of the fighter jock as we know him are coming to an end. . . . in 30 years, he or she will be pimply and horn-rimmed, but absolutely deadly in the air. .
"The cells that control our peripheral vision are much more sensitive than our focused vision. "
The sensors and computers that will be doing the targeting are going to be much more sensitive then eyeballs.
The eyes will only be handling the rough stuff anyway.