I know Futo has an app called Circles which is designed for things like that and staying in contact with family without social media. It’s supposedly E2EE and controlled by the person hosting the circle.
I haven’t used it yet for myself so I can’t say whether it’s good or not, but it sounds like something you might be interested in.