Do not switch to midnight time twice

Otherwise timezones with large offsets will make the day shift away by
two full days.

Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>