I have always had this experience. I never stopped to consider that others don't have it as well. Now I wonder how much this correlates to how people process information. I tend to visualize abstract concepts in some fashion, ever if I cannot describe what I am seeing.
Perhaps also relevant: I'm not much of a lip reader, but when I clearly can tell what someone is saying, I have an auditory response. I hear the words. Sometimes this is so strong that when viewing video, I have been fooled into thinking that there was actual audio, when there was none.
I wonder if this is the auditory version of vision whereby the brain fills in details that are not necessarily there.