We needed a new X with some of the archaic crap removed. I.e. no one needs X primitives anymore, everything is its own raster now (or whatever it’s called).
Evolving X would have given us incremental improvements over time… Eventually resulting in something like Wayland.