Fix a flaky test.

Yeah so actually this is precise enough that the thread waiting
is waking up and measuring time with less than 1ms latency.

Test: 100 times each test
Fixes: 137270720
Fixes: 137162797
Fixes: 136988752
Change-Id: I7da13e1bd175288005a821d3190637cf140fc6c6