Here's the answer to your problem. Notch added that sound effect so it adds more of an effect on underground areas. When your a few chunks within a cave, the noise will randomly happen, just don't worry about it. It's just a little something saying "Hey you! There's a cave over here!!" Well that's what I've been told anyways.