I took my father's keys when it was clear he was no longer safe driving. Despite his strokes and other medical problems, the CA DMV never cared and did not lift his license even when his health and incapacity was reported.
I was told it is against the law to take someone's license from them. Only the State can do that.