UK Police Forces Lobbied to Use Biased Face Scanning Systems
Police forces across the UK effectively campaigned to deploy a facial recognition system acknowledged as discriminatory against women, youths, and individuals from minority ethnic backgrounds, after complaining that a more accurate version generated a reduced number of potential suspects.
The Technology in Practice
UK forces use the national police database to carry out searches using historical face recognition. This process involves matching a “probe image” of a suspect against a repository of over 19 million mugshots to identify potential matches.
Acknowledged Discrimination
The Home Office conceded last week that the system was biased. This admission followed a study by the National Physical Laboratory (NPL) determined it misidentified Black and Asian people and women at much greater frequency than white men. The Home Office stated it “took steps on the findings”.
“This raises the issue of whether this technology only becomes useful if users accept biases in race and gender. Convenience is a weak argument for disregarding fundamental rights.”
Known Issue
Official papers reveal that this bias has been known about for over twelve months. Furthermore, law enforcement argued to overturn an initial decision that was designed to mitigate the problem.
Police bosses were notified of the system's bias in late 2024. The Home Office-commissioned NPL review found the system was more likely to produce incorrect matches for images depicting women, Black people, and those under 40 years old.
A Policy U-Turn
In reaction, the National Police Chiefs’ Council (NPCC) mandated that the confidence threshold required for possible hits be increased to a point where the bias was greatly diminished.
However, this directive was overturned the next month following complaints from police that the modified technology was generating a lower number of “useful lines of inquiry”. Internal records show the higher threshold reduced the number of searches that yielded possible identifications from over half to a mere under 15%.
Severe Disparities
Although the Home Office and NPCC refused to say what setting is currently used, the latest independent review discovered the system could produce false positives for Black women almost 100 times more frequently than for Caucasian women at certain settings.
The ministry stated on these findings: “Our evaluation identified that in a specific scenarios the algorithm is has a greater tendency to incorrectly include some population segments in its match reports.”
Operational Effectiveness vs. Bias
Outlining the effect of the temporary raise to the system's accuracy setting, the NPCC documents state: “The change significantly reduces the impact of discrimination across protected characteristics of ethnicity, generation and sex but had a substantially detrimental effect on police efficiency”. The papers add that forces complained that “a previously useful tool now delivered results of limited benefit”.
Broader Rollout Plans
Meanwhile, the government has opened a ten-week consultation on its plans to widen the use of biometric scanning systems. The minister for police the relevant minister has labeled the technology as the “most significant advance since DNA matching”.
Expert and Oversight Concerns
Abimbola Johnson, chair of the independent scrutiny and oversight board for the national policing equality strategy, said: “There was scant consideration in equality strategy sessions of the facial recognition rollout even with obvious cross-over with the strategy's goals.
“These revelations show yet again that the anti-racism commitments the police has made through the equality initiative are failing to be integrated into broader operations. Independent assessments have cautioned that new technologies are being implemented in a context where racial disparities, weak scrutiny and faulty information gathering continue to exist.
“Any use of facial recognition must adhere to rigorous official guidelines, be independently scrutinised, and prove it diminishes rather than exacerbates ethnic bias.”
Home Office Response
A government representative stated: “The Home Office takes the conclusions of the report seriously and we have already taken action. A new algorithm has been independently tested and acquired, which has no statistically significant bias. It will be tested in the coming months and will be subject to further assessment.
“The foremost aim is ensuring public safety. This revolutionary tool will assist officers to apprehend and prosecute offenders. There is human involvement in every step of the process and no further action would be pursued without trained officers meticulously examining the results.”