Mouse scrolling problem?

Every few scrolls with my mouse wheel, it'll jitter back and forth and really makes scrolling down pages impossible unless i hold the scroll bar and manually move it. It does this even though im only moving the wheel one direction.