This condition is known as intermittent esotropia. It is usually first spotted in very young children.
According to the Univeristy of Michigan Kellogg Eye Center:
Among adults, medical conditions like strokes,thyroid disease, diabetic nerve disease or head trauma can also cause an esotropia.
This type eye movement could also be considered Saccadic eye movement which is linked to Parkinson’s disease.