I felt the same way until I had a ROG strix RX-2700xt. I started getting fatal directx errors playing FFXIV all the time. It was an allocation problem and there was no driver version I could try that fixed it. I started trying to learn to custom-patch a driver, gave up, and bought an Nvidia card which I hated to do. Fixed the problem. Turns out the drivers for that specific card suck in general.
I still prefer AMD, but I’m wary of card manufacturers. Their drivers can be awful. In this case though, the default drivers didn’t work either. And you generally won’t know the word on the street until well after the cards aren’t higher end.
Anecdotal for sure, but it took a year of fighting on and off to fix and I don’t want that when I’m trying to relax.