How do you know that the color is the result of the interactions you describe, instead of the interactions just being the byproducts of the color? In other words our common sense perceptions, properly understood, are the indespensable starting place for describing reality, not just some superficial facade that is nothing more than our feeble attempts to interpret a more fundemental reality “underneath” or “more real” than perception.
A mirror maintains its original chemical composition and physical properties regardless of who's standing in front of it. But go to the clothing store and change outfits, and -- hey PRESTO! -- the mirror changes colors to reflect your new outfit.
(Sorry for the pun, it was inadvertent.)
For more details, go to Amazon.com and order a copy of Richard Feynman's QED: The Strange Theory of Light and Matter. Used copies from just over 2 bucks.
Cheers!