Deduplicate gathered file list first to avoid overprocessing

target file list is full of duplicates and iterating over that
list is slow due to the size, deduplicating first speed up the process
drastically.

Test: presubmit, manual
Bug: 433529093

Change-Id: I001337ee8a53a8862ef2cc18f277c0fd9f3358d4