As long as they come through the immigration system, I have no issues with those people coming to my neighborhood.
I think the two cultures I'd be scared of living next to are Rural Chinese people, the public shitting is just fucking bizarre and they seem fucking cutthroat, since they don't ever stand in lines.
and
going with ultra-conservative hasidic jews. They have some communities out east that are ultra-restrictive and also sap welfare programs unfairly.