Rights are granted to you as long as you follow the law that grants you them. Once you break the law certain rights can and will be taken away from you because you are no longer following the contract that allows you to have them.
There are certain inalienable human rights that every person should have. Slandering people and rallying up your cultists to attack those people is NOT one of them.