It’s wrong to initiate violence. Using force against people is only justified when it is used to stop an actual aggressor.
That is true in rich, pretty neighborhoods. It is also true in poor, rundown neighborhoods. It is true where there is a lot of violent crime. It is true where there is little or no violent crime.
It is true everywhere, all the time. That’s why it’s called the non-aggression principle, not the non-aggression “occasional mild suggestion, if it happens to be convenient at the time.”
The principle also applies regardless of someone’s skin color, IQ, income level, education level, place of birth, ancestry, age, sex, spiritual beliefs (or lack thereof), and so on.
If you condone the initiation of violence, then you are the obstacle to peaceful coexistence. You are the problem. You are the threat to freedom and justice. And if you advocate aggression, and then say it’s because the targets of that aggression are likely to be violent (based on some demographic category they belong to), then you’re a hypocritical statist asshole.