Most newbies would have a hard time and most experienced people would grab the “unofficial” non-free image for installing just in case and then disable non-free if it wasn’t needed.
I’ve not verified this, but does the installer actually install the non-free firmware if it’s not needed?