UK Government AI Tools Face Scrutiny Over Bias Concerns

The Guardian reported today that the UK government will soon publish details of AI tools used across various public sectors, following concerns about discrimination, or unconscious bias, that’s embedded in these technologies.

The decision to disclose these AI tools comes after pressure from transparency campaigners, who have raised alarms over possible discriminatory practices within the algorithms used with these systems. These AI tools have been used for tasks such as detecting sham marriages and identifying fraud in benefit claims.

The Public Law Project (PLP), an access-to-justice charity, has been at the forefront of this issue, advocating for more transparency and fairness in the deployment of such technology.

In August 2020, the Home Office agreed to suspend a computer algorithm used to sort visa applications after allegations of racism and bias. Officials halted the algorithm following a legal challenge by the Joint Council for the Welfare of Immigrants and the digital rights group Foxglove, as reported by the Guardian.

The Guardian also reports that Foxglove claimed that certain nationalities were automatically given a “red” risk score, leading to a higher likelihood of visa denial. They argued that this process amounted to racial discrimination.

The government’s Centre for Data Ethics and Innovation warned in a report that AI often amplifies biases. The center helped develop an algorithmic transparency recording standard for public bodies deploying AI and algorithmic tools, proposing that models interacting with the public or influencing decisions be published on a register.

As reported by the Guardian, the Department for Science, Innovation and Technology (DSIT) confirmed this weekend that departments would now report on their use of the technology under this standard.

A DSIT spokesperson said, “Technology has huge potential to improve public services, but we know it’s important to maintain the right safeguards including, where appropriate, human oversight and other forms of governance.”

“The algorithmic transparency recording standard is now mandatory for all departments, with a number of records due to be published shortly. We continue to explore how it can be expanded across the public sector. We encourage all organizations to use AI and data in a way that builds public trust through tools, guidance, and standards.”