Modded PSPs were the best way of playing retro games on the go for the longest time, I'd say it's only very recently that portable android consoles have even come close
I was unironically a massive fan of the PSTV, it was literally just a box with the internals of a Vita that you plugged into your TV. It was absolutely fantastic to be able to carry around a tiny console to hotels to get a proper gaming experience