Thanks for your post.
If we need to monitor GPU performance online so we can write(1 sec update time):
nvidia-smi -1