Yes. But the state still has to prove that what you did was a) a Nazi thing and b) that you either knew or should have known it was so.
So if you show the Hitler salute, you’ll be arrested and fined. If you give a speech in which you suggest that immigrants need to learn “the liberating power of work” (referencing the Motto of Auschwitz “Arbeit macht Frei” “Work makes Free”) that is totally fine.