If the timeout has been set to zero, don't register an end time.