An AI system claims to predict who will be a criminal based on people's photos. Actually it predicts who will be accused of crimes, using a simple heuristic: black skin => more likely to be accused.

The heuristic gives valid results because of the racism in society's systems.