Middle click camera panning is unreliable

I use middle click to pan the camera around.  Unfortunately, it appears to be unreliable in this patch.  I'm not sure why it isn't working or what makes it work and what doesn't, but about 70% of the time, I can not move the camera.  My thinking is that if the mouse is ever moving too slowly, the panning doesn't work.