Do setThreadPriority() later so we can notify the waiting thread

and release the lock as soon as possible even if we run the loop
in background priority.