Fix scroll thumb jumping ahead and returning back.
Note that this reverts changes made in an effort to make scroll listeners less noisy.