There are more things to a stable and sustainable society than economy.
With many European countries doing budget cuts to education, social security, healthcare etc many people are dissatisfied with their goverments. This can make it very hard to justify spending said budget on migrants or programs with aim to integrating migrants to the society.