I have 3-4-5 a day and haven’t permanently lost my house keys or wallet yet!
Many years ago I heard one single, solitary radio report that aspartame caused memory loss in children before that report got buried in deep hole somewhere, never to be repeated. Just like nicotine causing cancer, and cigarettes being addictive. The soft drink industry will pay.