The UK Home Office is increasingly relying on artificial intelligence and automated decision-making to assess asylum claims, according to a report by Open Rights Group. The technology is being rolled out in "near total secrecy," reproducing a digital version of the "hostile environment" policy introduced by Theresa May in 2012. This policy aimed to make life difficult for people living in the UK without legal immigration status.
The report highlights several uses of AI and automated decision-making in the immigration system. One example is the Identify and Prioritise Immigration Cases tool, which assesses the removability of people subject to immigration enforcement and recommends actions including detention and deportation. The Home Office disputes that this tool is an AI system, describing it instead as a rules-based system.
Another AI tool being used is facial age estimation, which the Home Office plans to roll out in 2027 to help determine whether people seeking asylum are adults or children. However, an evaluation of the Home Office's own AI trials found that nine percent of summaries produced were inaccurate or missing information. Almost a quarter of caseworkers involved in the trial expressed a lack of confidence in the summaries.
The report's author, Fabio Chiusi, cast doubt on the efficacy of human oversight in the AI decision-making process. He cited instances of automation bias, where humans tend to delegate responsibilities to machines and trust their judgments. Chiusi emphasized the need for transparency and regulation in the use of AI tools in the immigration system.
The Home Office has acknowledged that its facial age estimation technology can vary in accuracy depending on a person's ethnicity and skin tone. The consequences of inaccurate age estimation could be severe, particularly for unaccompanied minors. If a person is determined to be an adult, they lose accommodation and legal rights that minors receive.
The report also highlights problems with an automated system designed to identify potential sham marriages. Introduced in 2015, the tool adopted machine learning in 2019 and remains in use. An internal Home Office evaluation found that people from certain nationalities, including Albania, Greece, Romania, and Bulgaria, were disproportionately flagged.
A Home Office spokesperson said that AI is "just one tool" to protect borders and that asylum decisions are made by trained caseworkers, with AI tools used only to assist in navigating interview records and policy information. The government has big plans to roll out AI tools across public services, but concerns over transparency and discrimination remain.
Key points
- The UK Home Office is using AI tools in the immigration system despite concerns over transparency and discrimination.
- The technology is being rolled out in "near total secrecy," reproducing a digital version of the "hostile environment" policy.
- The report's author emphasizes the need for transparency and regulation in the use of AI tools in the immigration system.