Another name for them would be adversarial multiplayer. But, basically yes. Anything where there would be winners and losers is what I would call a competitive game.
Though others narrow it down further to more high skill adversarial games like Quake and Counter-Strike and League of Legends/DOTA for their professional competitive leagues.