Me too, but as you say, chartreuse is unique. It’s named after a liqueur that has two flavors, a green and a yellow, making it the only color name that has two distinct definitions.
Mom got a chartreuse sofa (The yellow chartreuse, not the green one) that became my definition of chartreuse. Decades later, a girlfriend described something as chartreuse (the green chartreuse not the yellow chartreuse). Hilarity ensued.
Other than that 5 colors suffices for most everything, except resistor color codes which expand the pallet to 10 colors. (OK, maybe we can add gold and silver for tolerance bands).
The non-binaries would see that as "oppressive" LOL