I agree with your last statement, but I actually really enjoyed the puzzles in Spider-Man 1. The story-based ones were never difficult, and for the optional ones, I just waited until I was in the mood for some puzzles, and then blew through them all in one go.
But if you don’t like puzzles at all, I understand turning them off.