Just keep practicing and pay attention to your timing and extra attention to sliding your front foot instead of stomp jumping. If it only happens once in a while it's probably your brain still getting used to how ollies work. They are a weird concept if you look at it from a non-skate perspective.