How do I turn it off?

I'm not aware of a way to, but you could at least minimize how much it Zooms per mouse-wheel click, by setting the ZOOMFACTOR System Variable to the minimum value of 3.