Add performance test for suggestConversationActions and detectLanguage
This is the framework used by other system component like autofill. We will use this to answer system health question. We can also monitor the metric in this dashboard once it is submitted. https://blackbox.googleplex.com/#/custom/fw_other Result in pixel2 eng build (unit: nano second) (We will have more accurate result in the dashboard, we are advised not to run perf test in eng build) android.textclassifier.TextClassifierPerfTest:INSTRUMENTATION_STATUS: detectLanguage[size=0]_mean=15010771 INSTRUMENTATION_STATUS: detectLanguage[size=0]_median=15203514 INSTRUMENTATION_STATUS: detectLanguage[size=0]_min=10497747 INSTRUMENTATION_STATUS: detectLanguage[size=0]_standardDeviation=3061947 INSTRUMENTATION_STATUS_CODE: -1 .INSTRUMENTATION_STATUS: suggestConversationActions[size=0]_mean=39863316 INSTRUMENTATION_STATUS: suggestConversationActions[size=0]_median=41535711 INSTRUMENTATION_STATUS: suggestConversationActions[size=0]_min=35979326 INSTRUMENTATION_STATUS: suggestConversationActions[size=0]_standardDeviation=3297779 INSTRUMENTATION_STATUS_CODE: -1 .INSTRUMENTATION_STATUS: detectLanguage[size=10]_mean=14711781 INSTRUMENTATION_STATUS: detectLanguage[size=10]_median=13608035 INSTRUMENTATION_STATUS: detectLanguage[size=10]_min=12184472 INSTRUMENTATION_STATUS: detectLanguage[size=10]_standardDeviation=3144018 INSTRUMENTATION_STATUS_CODE: -1 .INSTRUMENTATION_STATUS: suggestConversationActions[size=10]_mean=43076381 INSTRUMENTATION_STATUS: suggestConversationActions[size=10]_median=43618067 INSTRUMENTATION_STATUS: suggestConversationActions[size=10]_min=38747603 INSTRUMENTATION_STATUS: suggestConversationActions[size=10]_standardDeviation=3502977 INSTRUMENTATION_STATUS_CODE: -1 .INSTRUMENTATION_STATUS: detectLanguage[size=100]_mean=20646733 INSTRUMENTATION_STATUS: detectLanguage[size=100]_median=20766674 INSTRUMENTATION_STATUS: detectLanguage[size=100]_min=19184218 INSTRUMENTATION_STATUS: detectLanguage[size=100]_standardDeviation=892559 INSTRUMENTATION_STATUS_CODE: -1 .INSTRUMENTATION_STATUS: suggestConversationActions[size=100]_mean=42126088 INSTRUMENTATION_STATUS: suggestConversationActions[size=100]_median=43709436 INSTRUMENTATION_STATUS: suggestConversationActions[size=100]_min=36636031 INSTRUMENTATION_STATUS: suggestConversationActions[size=100]_standardDeviation=4863678 INSTRUMENTATION_STATUS_CODE: -1 .INSTRUMENTATION_STATUS: detectLanguage[size=1,000]_mean=21721753 INSTRUMENTATION_STATUS: detectLanguage[size=1,000]_median=22690096 INSTRUMENTATION_STATUS: detectLanguage[size=1,000]_min=16252464 INSTRUMENTATION_STATUS: detectLanguage[size=1,000]_standardDeviation=3445673 INSTRUMENTATION_STATUS_CODE: -1 .INSTRUMENTATION_STATUS: suggestConversationActions[size=1,000]_mean=45968389 INSTRUMENTATION_STATUS: suggestConversationActions[size=1,000]_median=47465009 INSTRUMENTATION_STATUS: suggestConversationActions[size=1,000]_min=39389483 INSTRUMENTATION_STATUS: suggestConversationActions[size=1,000]_standardDeviation=3820288 INSTRUMENTATION_STATUS_CODE: -1 Test: Run commands below mmma -j ./frameworks/base/apct-tests/perftests/core/; adb install -r $OUT/data/app/CorePerfTests/CorePerfTests.apk; adb shell am instrument -w -e class android.textclassifier.TextClassifierPerfTest com.android.perftests.core/android.support.test.runner.AndroidJUnitRunner adb shell cmd package compile -m speed -f com.android.perftests.core; Change-Id: Ia2c746f48ed018269a230422a695caca05844a12
Loading
Please register or sign in to comment