There's actually a name for this....I'll have to go look it up, but it's a documented medical fact that some people 'see' sounds and 'taste' colors.
You're not alone, btw (as the above responses have shown). I experience sort of the same thing....