NLE saves recordings of each run in the .ttyrec format. If you are like me and attempt to playback those files with “regular” ttyplay, then you’ll run into some difficulties (and the ttyrec will show up as garbage or without color or other issues). NLE packages their own version of ttyplay that works very well (and even offers color support!).
So after completing the regular starter-kit setup, you can run the random agent with a command like:
cd nethack_baselines/other_examples/
python random_rollouts.py
Exit early (may need to ctrl+c or close the terminal window) after a few iterations complete, then go into your specific log directory created within your other_examples
folder (your specific folder / file names will be different from mine):
cd nle_data/20210623-111529_w6kyd95y/
nle-ttyplay nle.60710.0.ttyrec.bz2
And this will let you watch the recording of what your agent performed during that run!
Good luck, have fun!