Yep. The first few hours of a game are really important. If people tell me it gets better later I usually assume they are suffering from sunk-cost at that point. There are some games that genuinely start slow and end up really good, but it's not common.
Terraria is a 2D sandbox but with good progression built in with interesting bosses and items. The early game in these games are usually the most fun in my opinion, building up from nothing is satisfying.