Test: Await worker_thread before drop it

Call .await to ensure the task is cancelled before we drop it.
This change is hopefully to fix a bug that the aborted task is
still running.

Bug: 235763745
Test: atest
Change-Id: Id2982211055661c5a74bcce7332f694f4782438b