I first heard of this a couple of years ago, and was astounded to find that other people saw colors in letters and numbers like I do. I have tried for years to explain this to my husband, who always just gives me that patronizing look and changes the subject.
BTW, 4 is red, F is yellow, L is brown.
Maybe some people associate colors and numbers from years of painting Paint By Numbers as kids.