As long as there are multiple communities for the same topic, users are going to post the same links to multiple communities. The software has to handle it better. I submitted a proposal to solve it, but one of the lemmy devs have said explicitly that they won't implement it and they don't think duplicate posts are an issue.