Because other than Jews, everyone else is third class “citizens”. You have specific roads that you use, specific areas that you can live or work, your school is different and get treated differently as well.
Note: why I mentioned third class, it’s because black and non-white Jews are their second class citizens.