I did it years ago. I never noticed any retaliation, but the lack of garage in my mailbox is noticeable. I swear some of those credit cards would send daily letters!
Sure, vendors who already have my information still send me things, but I just call them and get them to remove me from the list. Now the only thing that remains is the political junk mail you can do nothing about.