British Police Built a Sprawling Crime-Prediction Machine. Some Results Couldn’t Be Trusted
UK police built a crime-prediction machine with untrustworthy results.
An investigation into the Avon and Somerset Police's predictive analytics program revealed that at least two risk-scoring models were abandoned due to untrustworthy results. The program, which involved a database of nearly half a million people, assigned risk scores based on sensitive personal information. Concerns were raised about transparency and the accuracy of these algorithms, with some showing "genuinely poor predictive performance."
AI summary of the linked source. Not reviewed by an editor. How this works
Run Avon and Somerset Police?
Get an email when a new story names Avon and Somerset Police, usually within the hour.
Free. Your list stays private and never appears in a subject line. One click stops it. How Vendor Watch worksPrivacy
The lesson from this incident
Full lessonAvon and Somerset Police deployed a predictive crime-scoring system covering nearly half a million individuals using sensitive personal data, yet at least two core models were quietly abandoned after producing untrustworthy results. The root failure lies in deploying consequential algorithmic systems without rigorous validation, transparency, or accountability frameworks — meaning real people may have faced policing decisions based on flawed scores. This matters because inaccurate risk models applied to law enforcement can reinforce bias, violate civil liberties, and erode public trust. Organizations handling sensitive personal data at this scale have legal and ethical obligations to ensure algorithmic outputs are auditable, accurate, and explainable before deployment.