[Ravenwood] Dedup annotation allowed class list

Also manually remove inner classes in the list that is not needed.

Bug: 292141694
Flag: EXEMPT host side change only
Test: m ravenwood-runtime
Change-Id: I37b164293b333af2f8427d3deaa2b6317d3bd355