You also might check that the hardware clock is reasonably close to the system time. If you reboot and the hardware clock is way off then ntp will not be able to bring it back and give up. I've had that happen. So do a hwclock --systohc once in a while to update the hardware clock.