←新闻详情

Wired AI更新于 10月28日 10:33

英国边境监察机构或调查内政部使用OpenAI工具处理庇护申请

UK Home Office May Face Investigation Over Use of OpenAI Tech | WIRED

AI 导读

英国边境与移民独立首席监察员(ICIBI)正考虑调查内政部使用生成式AI工具处理庇护申请的情况,已要求数字权利组织 Open Rights Group 提供更多信息。内政部使用的 Asylum Case Summarisation 和 Asylum Policy Search 工具基于 OpenAI 2023 年的 GPT-4 与 Microsoft Foundry 构建,于 2024 年底开始试点。ORG 为期六个月的调查发现,ACS 生成的摘要中被判定不可用的比例明显高于试点评估公布的 9% 错误率,APS 生成的摘要则没有质量控制;这些工具也未列入英国政府要求公开的算法工具清单。

推荐理由

AI 评分 67

报道披露英国庇护审批中AI工具的实际使用与监管缺位,读者可据此了解高风险公共决策场景的合规争议。

主题

标签

正文

A UK government watchdog is considering an investigation into the Home Office’s use of generative AI tools to process asylum applications, WIRED has learned. The potential probe follows lawmakers and researchers publicly questioning the tools’ accuracy and the government’s secrecy around their use.

The Independent Chief Inspector of Borders and Immigration (ICIBI), which monitors the Home Office’s management of borders, immigration, and customs, has asked digital rights nonprofit Open Rights Group (ORG) to share more information on the tools as it draws up plans for the topics it will inspect next year, campaigner Sara Alsherif tells WIRED. ORG’s findings come from a six-month investigation into the tools, which involved 11 parliamentary questions, two ministerial letters, and 10 public records requests that attempt to pry details from the Home Office, which has withheld details on the tools.

The ICIBI tells WIRED it cannot confirm what topics are under active consideration before it publishes its annual inspection priorities, but it says it is aware of concerns about the use of AI tools and pointed to its findings last year that one of the tool’s “effectiveness and reliability were varied.”

“Asylum decisions are made by trained caseworkers, with AI tools used only to assist in navigating interview records and policy information. They cannot be used in isolation and do not make decisions on claims,” a Home Office spokesperson tells WIRED in an email. “We regularly monitor the performance of these tools alongside our established quality-assurance processes, and have already committed to publishing updated evaluations on their roll out.”

The Home Office uses the Asylum Case Summarisation (ACS) and Asylum Policy Search (APS) tools, built on OpenAI’s 2023 GPT-4 large language model and Microsoft Foundry, to summarize transcripts of interviews with asylum applicants and information about their countries of origin, according to documents obtained by ORG. The immigration and law enforcement authority started piloting these tools in late 2024 as the Labour government tried to clear a backlog of around 100,000 asylum cases, while staying on top of the tens of thousands of new applications the UK receives each year. While the department has made significant progress, halving the number of people waiting on an initial decision in the year through June, the number of appeals against decisions has ballooned.

Researchers are concerned about the accuracy of the AI tools–especially to decide something as high-stakes as whether to send someone back to a country where they fear persecution. ORG found that the percentage of summaries generated by the ACS deemed not fit for use—often because they contain factual errors or misrepresentations—is significantly higher than the published 9 percent error rate calculated in the pilot evaluation. There is no quality control for the summaries produced by the APS, it also found.

Asylum decision-makers use the tools to save time when reviewing asylum cases; when used together, the pilot showed the tools could save around an hour per case, according to government estimates. Caseworkers use the ACS to speed up their review of transcripts of interviews where asylum seekers explain how they were persecuted in their country and why they are afraid to return. They use the APS as a search assistant to find and summarize country policy information, which informs them whether the applicant faces a genuine risk of harm in their home country. In July, a UK judge accused the Home Office of citing an “AI hallucinated” document to refuse a Moroccan woman and her child’s asylum claim on the basis that her home country would be safe for her to return to.

“We’re dealing with people’s lives. We’re talking about people that have faced some of the worst circumstances, and we’re meant to be making decisions based on facts and on understanding harm,” Labour backbench MP Bell Ribeiro-Addy tells WIRED. “I just don’t think it’s appropriate that machines are doing that.”

A Home Office spokesperson says, “Use of Artificial Intelligence is just one of the tools at our disposal to protect our borders, and does not replace or automate the role of human decision-makers.”

Ribeiro-Addy, Alsherif, and the Public Law Project, which has separately been investigating the tools, also worry that well-documented “cultural bias” in GPT models could lead to language barriers and the loss of cultural nuances in the summaries, which could in turn result in discriminatory decisions. An OpenAI spokesperson highlighted to WIRED the company’s ongoing work to improve its models’ accuracy and pointed out that the company will be retiring GPT-4 in January.

In the absence of regulation, the UK’s “AI Playbook” mandates that departments must be transparent about the algorithmic tools they use in decision-making processes and make information on them available to the public, including listing those tools on a public repository. The Home Office’s case summarization and policy search tools are not on that list.

Asylum seekers are also not told when these AI tools are used in their case. “Migrant organizations, legal practitioners, not many of them know about the actual use of this tool,” says Alsherif, who leads ORG’s migrant digital justice program. “So we need to let them know about this, let them know how it works, so they can challenge it.” Not being able to contest an incorrect AI summary of their personal information may breach UK data rights laws, Cloisters lawyers wrote in an independent legal opinion commissioned by ORG. The Home Office states that parts of the decision-making process may involve automation in its privacy notice.

Both groups have sent their findings to UK data regulator, the Information Commission, which is currently investigating the Home Office’s refusal to tell ORG how staff use and were trained to use two AI tools.

Public Law Project senior research fellow Caroline Selman also notes that the ACS and APS tools are just two of the 11 high-risk AI systems that her team has found being used across government but absent from the public repository. She’s concerned there may be more deployed across government that even researchers, let alone the individuals they are being used on, are unaware of.

“Other tools are being used but not being publicized at all,” says Selman, “and you can’t even begin to ask questions about things if you don’t know that they’re being used.”

Airbnb hosts are furious they can no longer make guests do their chores

big story: cool kids write in all lowercase—does that make you mad?

I worked for a whole day using only the iPhone Duo

WIRED event: The technologies, people, and ideas transforming our worldTopicsUKgovernmentartificial intelligenceOpenAIChatGPTimmigrationAnthropic Says It Will Revolutionize Biology—Some DayIn breathless press releases and posts, the company has touted its models’ ability to deliver scientific breakthroughs. But its IPO filing taps the brakes on just how fast its AI will lead to big discoveries.Emily MullinI Love the Skylight Calendar, but This Subscription-Free Rival Is $100 OffThe Everblog HomeCal delivers a similar experience, including a digital photo frame and meal planning at no extra cost. Nena Farrell Motorola Is Offering a Free Smartwatch and Earbuds When You Buy a RazrThe Razr is our favorite budget foldable phone. While it isn’t on sale yet, Motorola is adding extras to sweeten this October deal.Les ShuAnthropic Flags Gas Supply as One of Its Biggest Near-Term RisksThe data center buildout could cause a massive increase in gas prices as companies scramble for limited supplies and infrastructure fails to meet demand.Molly TaftCan’t Wait for Black Friday? Check Out These Live DealsThe early bird gets the worm. Here are the best Black Friday deals for 2026 you can already get right now.Simon HillThis Quince Tee Is the Perfect Entry Point Into Merino WoolMerino wool is a super fiber, and Quince’s all-season tee is the perfect way to try it out without spending a fortune.Scott GilbertsonA 28-Year-Old DOGE Operative Gutted USAID. HR Had No Record of Him Working ThereDespite the agency's human resources department saying he hadn’t even been onboarded, Jeremy Lewin oversaw the destruction of USAID. It’s not clear he had the legal authority to do so.Molly Knight RaskinUK Home Office May Face Investigation Over Use of OpenAI TechA government watchdog is considering a probe into the Home Office’s use of ChatGPT technology to process asylum claims amid concerns over the tools’ accuracy and secrecy surrounding their use.Isabella WardUK Politician Jess Asato Got Deepfaked. Now She’s Taking xAI to CourtJess Asato’s public campaigning for victims of online abuse put her in the crosshairs of Grok’s deepfake scandal. Then the UK member of parliament became a victim of the abuse herself.Rosie SwashAI Agents Are Media’s New Favorite AudienceAs agents go mainstream, some publishers are hoping that people will pay for content tailor-made for AI—not humans.Kate TaylorNASA’s Oldest Martian Spacecraft Have Been Running for Decades. Here’s HowTwo orbiters have long outlasted their expected lifespans and completely reshaped our understanding of the Red Planet, all while operating 140 million miles from Earth.Meghan BartelsInstagram Is a Streaming Service NowInstagram’s long-form video update is more than a swipe at YouTube. It’s an attempt to capture the clip economy.Reece Rogers

来源

Wired AI