I use mailfence. They offer imap, caldav, and carddav. It’ll check all those boxes, but I don’t think those are unique offerings among the privacy respecting email services.
I use Proton Mail’s Proton Calendar app for my calendar though. I was using caldav + davx5 but I had issues with reminder settings getting lost on recurring events.