AI vs. the health bureaucracy

From: POLITICO's Digital Future Daily - Monday Oct 30,2023 08:20 pm
How the next wave of technology is upending the global economy and its power structures
Oct 30, 2023 View in browser
 
POLITICO's Digital Future Daily newsletter logo

By Derek Robertson

FILE - The Department of Health and Human Services building is shown on April 5, 2009, in Washington. Children in many states are being wrongly cut off from Medicaid because of a “glitch” in the automated systems being used in a massive eligibility review for the government-run health care program, a top Medicaid official said Wednesday, Aug. 30, 2023. (AP Photo/Alex Brandon, File)

The Department of Health and Human Services headquarters. | AP

Now that the Biden administration has finally issued its long-awaited executive order on AI, it’s worth considering just how tricky it will be for the lumbering bureaucracy to keep up with a technology that can quite literally teach itself how to change and adapt to its environment.

POLITICO’s Daniel Payne tackled that very subject in a report published over the weekend covering how AI products are hitting doctors’ offices and hospitals across the country without the voluminous amount of testing that the government usually requires for new medical tools. That poses a big problem when the unanswered questions surrounding privacy, bias and accuracy in AI are applied to quite literally life-and-death situations.

Suresh Venkatasubramanian, a Brown University computer scientist who helped draft last year’s Blueprint for an AI Bill of Rights, told Daniel, “There’s no good testing going on and then they’re being used in patient-facing situations — and that’s really bad.” Even one CEO of an AI health tech company expressed concern that users of his software “would start just kind of blindly trusting it.”

Troy Tazbaz, the director of the Food and Drug Administration’s Digital Health Center of Excellence, acknowledged that the FDA (which falls under the Department of Health and Human Services) needs to do more to regulate AI products even as they hit the market, saying they might require “a vastly different paradigm” from the one in place now. Daniel writes that Tazbaz foresees “a process of ongoing audits and certifications of AI products, hoping to ensure continuing safety as the systems change” — echoing the type of “agile” regulatory framework proposed in a recent book by former Federal Communications Commision Chair Tom Wheeler.

The White House’s new executive order, in the meantime, looks to spur the agencies forward. As POLITICO’s Mohar Chatterjee and Rebecca Kern wrote in their exclusive look at the order published Friday, it directs HHS to develop a “strategic plan” for AI within the year. HHS is also directed to determine whether AI meets the government’s standards when it comes to drug and device safety, research, and promoting public health, and to evaluate and mitigate the risk that AI products could discriminate against patients.

According to the draft of the executive order, the HHS’s AI “Task Force” will be responsible for the “development, maintenance, and use of predictive and generative AI-enabled technologies in healthcare delivery,” “taking into account considerations such as appropriate human oversight of the application of AI-generated output.” It’ll also be required to monitor AI performance and outcomes like any other products, develop a strategy to encourage AI-assisted discovery of new drugs and treatment, and help determine the risks of AI-generated bioweapons.

The EO doesn’t necessarily set new rules around AI safety and privacy concerns in health care, but rather sets a plan in motion to create them. (Eventually. Maybe.) But even with this most sensitive — and highly regulated — of policy subjects, experts and lawmakers are skeptical about when or whether actual, legislative action might be taken once that plan is in place.

Brad Thompson, an attorney at Epstein Becker & Green who counsels companies on AI in health care, told Daniel the legislative “avenue just isn’t available now or in the foreseeable future.” Rep. Greg Murphy (R-N.C.), co-chair of the House’s Doctors Caucus, said state government should take the lead.

So in the meantime, it’ll be up to the executive order-mandated “task force” to suggest rules for how to deploy and regulate AI tools in health care most responsibly, and to the medical sector to follow them. As Divyansh Kaushik, associate director for emerging technologies and national security at the Federation of American Scientists, told Mohar ahead of the order’s publication today: “Issuing the EO is the first step. Now comes the budget battle, then comes the implementation.”

 

GET READY FOR POLITICO’S DEFENSE SUMMIT ON 11/14: Russia’s war on Ukraine … China’s threats to Taiwan … a war in Gaza. The U.S. is under increasing pressure to deter, defend and fight in more ways — but not everyone agrees how. Join POLITICO's 3rd Annual Defense Summit on November 14 for exclusive interviews and expert discussions on global security and the U.S.'s race to bolster alliances and stay ahead of adversaries. Explore critical topics, including international conflicts, advanced technology, spending priorities and political dynamics shaping global defense strategies. Don’t miss these timely and important discussions. REGISTER HERE.

 
 
the future of drone warfare

Drone warfare is transforming the battlefield in Europe, bringing major ramifications for the rest of the world.

POLITICO’s Veronica Melkozerova reports on how $400 commercial drones are besting the Russian military in Ukraine, similar to how Hamas militants have leveled the technological playing field in Israel and Gaza. Using drones with parts largely manufactured in China — something that’s led that country to restrict exports to both sides of the Ukraine war — Ukranian pilots can effectively learn to pilot first-person view kamikaze drones in less than a month.

"FPV drones are effective tools for destroying the enemy and protecting our country. The Ministry of Defense is doing everything possible to increase number of drones," Ukraine’s Defense Minister Rustam Umerov said in a statement Wednesday.

They’re so effective, in fact, that the director of the drone training academy outside Kyiv predicts they could be coming soon to national capitals across the continent.

“It is almost impossible to shoot it down," Pavlo Tsybenko told Veronica. "Only a net can help. And I predict that soon we will have to put up such nets above our cities, or at least government buildings, all over Europe.”

u.k. summit agenda

Prime Minister Rishi Sunak gestures during the Conservative Party conference in Manchester, England, on Oct. 4, 2023.

United Kingdom Prime Minister Rishi Sunak. | Jon Super/AP Photo

And now, some AI news from the other side of the pond: POLITICO’s Vincent Manancourt reported today for Pro s on what to expect at this week’s long-awaited United Kingdom AI summit.

Wednesday will feature a discussion among a wider group of countries, and Thursday will future leaders from select nations to discuss the potential threats of AI to global security. Attendees will include Vice President Kamala Harris, European Commission President Ursula von der Leyen, United Nations chief António Guterres, and Italy’s Prime Minister Giorgia Meloni among others.

The summit will also feature representatives from the private sector, although there’s an element of exclusivity there too: The first day will have a wider group of companies including Palantir, Faculty, Salesforce, Hugging Face, Cohere, Conjecture, and Stability AI among nine other tech giants, while day two will include Amazon, Anthropic, Google, Inflection, Meta, Microsoft and OpenAI, as well as Elon Musk’s xAI and France’s Mistral.

And what’s actually expected to happen? Vincent writes that U.K. Prime Minister Rishi Sunak is hoping for four main outcomes: A statement on AI risk that the U.S. and China can both get behind; an agreement to create a network of AI researchers similar to the Intergovernmental Panel on Climate Change; plans for an AI Safety Institute; and commitments from AI companies to build on the voluntary safety commitments they made to the Biden White House.

Tweet of the Day

infrastructure that looks like sci fi1/ liquid natural gas tanker

THE FUTURE IN 5 LINKS
  • Gannett is denying claims that it used AI to write product reviews.
  • How good is AI at meeting the standard benchmarks for a financial adviser?
  • Investors largely believe in AI, but they aren’t going all in yet.
  • Could personalized brain implants help with disorders like OCD?
  • Meta’s head of AI research talks about the delicate balance of open-source models.

Stay in touch with the whole team: Ben Schreckinger (bschreckinger@politico.com); Derek Robertson (drobertson@politico.com); Mohar Chatterjee (mchatterjee@politico.com); Steve Heuser (sheuser@politico.com); Nate Robson (nrobson@politico.com) and Daniella Cheslow (dcheslow@politico.com).

If you’ve had this newsletter forwarded to you, you can sign up and read our mission statement at the links provided.

 

The World Strategic Forum (WSF) is taking place on November 6-7th in Miami, Florida at the Biltmore Hotel Coral Gables. WSF 2023 will discuss ‘Mastering the New Economy’, examining the ways in which business and society can thrive despite current economic and environmental challenges. The conference will gather 100+ speakers from companies including Volkswagen, Siemens and C3.ai, as well as U.S. Senator for Tennessee Bill Hagerty; Florida’s Chief Financial Officer Jimmy Patronis; Former President of Colombia Iván Duque Márquez and Former President of Ecuador Jamil Mahuad. Learn more and register now at www.worldstrategicforum.com.

 
 
 

Follow us on Twitter

Ben Schreckinger @SchreckReports

Derek Robertson @afternoondelete

Steve Heuser @sfheuser

 

Follow us

Follow us on Facebook Follow us on Twitter Follow us on Instagram Listen on Apple Podcast
 

To change your alert settings, please log in at https://www.politico.com/_login?base=https%3A%2F%2Fwww.politico.com/settings

This email was sent to by: POLITICO, LLC 1000 Wilson Blvd. Arlington, VA, 22209, USA

Please click here and follow the steps to .

More emails from POLITICO's Digital Future Daily

Oct 27,2023 08:03 pm - Friday

5 questions for Francesco Marconi

Oct 26,2023 08:20 pm - Thursday

The quantum here-and-now

Oct 25,2023 08:39 pm - Wednesday

When 'red-teaming' AI isn't enough

Oct 24,2023 08:03 pm - Tuesday

GPS ‘spoofing’ thickens the fog of war

Oct 20,2023 08:39 pm - Friday

5 questions for Zak Kallenborn

Oct 18,2023 08:23 pm - Wednesday

The electric-vehicle utopia, running on fumes