Hi, in remote/pai/kubeflow mode, NNI need another port to accept metric data from trail_keeper, so if we support this kind of running mode, NNI may need a lot of refactor change, it might be a big effort. As we discussed internal, we may not support this feature. If you have another good suggestion, please feel free to give feedback. Thanks!

reopen, as I'm thinking whether we can save the key results info in a JSON or HTML format just for browsing. open to discussion.

Same need. any updates?

maybe you can write shell script like

#!/bin/bash
for file in nni-experiments/$1/trials/*
do
    if test -d $file
    then
         log=`cat "$file/trial.log" | grep 'test_acc'`
        echo "$file""$log"
    fi
done

To sort your metric, use ./nni_best.sh <expID> | sort -n -k 4 -t :

same here +1, hope to hear your expertise on the latest progress about the feature.