Well, right, it's contextual. We each have a series of inputs that add up to these contexts. This doesn't mean it can't be explained, it just means there needs to be context.
If you give the blind man a sensor that converts color data to something he can input, and then provide inputs giving the feeling you want to portray associated with that color, you have explained it.
If you feel red is angry, all you need to do is play 400 to 484 THz into his instrument and yell at him angrily enough times for him to associate it. It doesn't seem too subjective to me.
Color perception has nothing to do with light wavelength. Color is a subjective perceptual space.
If you zap your occipital cortex with electromagnetic pulses, you'll experience color flashes (phosphenes).
If a blind person who can read baille does the same, they'll experience tingling sensations in their fingers [1].
People can have visual experiences through somesthesic stimuli (you can give muddy waters divers sonar-based sight by stimulating their skin with an electrode array).
AFAIK, it is not however know whether someone who was blind at birth and whose brain didn't learn to see could have such experiences.
1. https://link.springer.com/article/10.1007/s00221-007-1091-0 full text: https://d1wqtxts1xzle7.cloudfront.net/50371662/s00221-007-10...