High resource usage (RAM, but also CPU), slow syncs especially after being offline for a longer time with many public rooms, group chats are hard with encryption (new members can’t read old messages because secure key sharing wasn’t solved yet), if your partner did not set up key backup they’ll have problems with access to messages when moving or just switching devices
I would say though that the problems of Tox sound to be more serious