I think you missed the group of poorer citizens who felt that foreign labour was driving down wages and limiting access to jobs.
Of course, some employers advertising for Czech or Polish only speakers didn't help nor did job agencies recruiting solely in Eastern European countries.