The United States’ secretive Special Operations Command is looking for companies to help create deepfake internet users so convincing that neither humans nor computers will be able to detect they are fake, according to a procurement document reviewed by The Intercept.

The plan, mentioned in a new 76-page wish list by the Department of Defense’s Joint Special Operations Command, or JSOC, outlines advanced technologies desired for country’s most elite, clandestine military efforts. “Special Operations Forces (SOF) are interested in technologies that can generate convincing online personas for use on social media platforms, social networking sites, and other online content,” the entry reads.

The document specifies that JSOC wants the ability to create online user profiles that “appear to be a unique individual that is recognizable as human but does not exist in the real world,” with each featuring “multiple expressions” and “Government Identification quality photos”…

… The Pentagon has already been caught using phony social media users to further its interests in recent years. In 2022, Meta and Twitter removed a propaganda network using faked accounts operated by U.S. Central Command, including some with profile pictures generated with methods similar to those outlined by JSOC. A 2024 Reuters investigation revealed a Special Operations Command campaign using fake social media users aimed at undermining foreign confidence in China’s Covid vaccine.

Last year, Special Operations Command, or SOCOM, expressed interest in using video “deepfakes,” a general term for synthesized audiovisual data meant to be indistinguishable from a genuine recording, for “influence operations, digital deception, communication disruption, and disinformation campaigns.”

… special operations troops “will use this capability to gather information from public online forums,” with no further explanation of how these artificial internet users will be used…

The offensive use of this technology by the U.S. would, naturally, spur its proliferation and normalize it as a tool for all governments. “What’s notable about this technology is that it is purely of a deceptive nature,” said Heidy Khlaaf, chief AI scientist at the AI Now Institute. “There are no legitimate use cases besides deception, and it is concerning to see the U.S. military lean into a use of a technology they have themselves warned against. This will only embolden other militaries or adversaries to do the same, leading to a society where it is increasingly difficult to ascertain truth from fiction and muddling the geopolitical sphere.”

Both Russia and China have been caught using deepfaked video and user avatars in their online propaganda efforts, prompting the State Department to announce an international “Framework to Counter Foreign State Information Manipulation” in January. “Foreign information manipulation and interference is a national security threat to the United States as well as to its allies and partners,” a State Department press release said. “Authoritarian governments use information manipulation to shred the fabric of free and democratic societies”…

  • RangerJosie@lemmy.worldEnglish
    2·
    2 months ago

    Unfortunately thats pretty far down the list. This is to sow dissent and stir up shit in “Enemy” nations like Russia or China, especially China, and pretty much any other country where the US isnt free to Serve & Protect as the World’s Policeman while it extracts all the natural resources and installs puppet governments that answer to the US.

    • masquenox@lemmy.world
      21·
      2 months ago

      Fair enough, but they can expect nothing but rapidly dimunishing returns with this kind of chicanery.

      The South African regime slamming the window down on Biden’s (and it’s collaborator elements in South Africa) fingers at the ICJ was essentially payback for the psyop the US tried to run here back in 2022 with the whole “Lady R” thing.

      I do not agree that this will all lead "to a society where it is increasingly difficult to ascertain truth from fiction and muddling the geopolitical sphere.”

      I’d say it’s going to do the exact opposite, ie leading to a society that is more clued up about the shitfuckery of governments that is unprecedented in history.

      • RangerJosie@lemmy.worldEnglish
        2·
        2 months ago

        I’m an American. And I long to see it fall. I dont care what supplants it on the world stage. A coalition of the “Global South” or BRICS or whatever.

        Even knowing how screwed I’ll be here living through the fallout. I’d say we’re due. After more than a century of brutalizing the rest of the world.