Current:Home > InvestMicrosoft says US rivals are beginning to use generative AI in offensive cyber operations-VaTradeCoin
Microsoft says US rivals are beginning to use generative AI in offensive cyber operations
View Date:2025-01-19 03:20:29
BOSTON (AP) — Microsoft said Wednesday it had detected and disrupted instances of U.S. adversaries — chiefly Iran and North Korea and to a lesser extent Russia and China — using or attempting to exploit generative artificial intelligence developed by the company and its business partner to mount or research offensive cyber operations.
The techniques Microsoft observed, in collaboration with its partner OpenAI, represent an emerging threat and were neither “particularly novel or unique,” the Redmond, Washington, company said in a blog post.
But the blog does offer insight into how U.S. geopolitical rivals have been using large-language models to expand their ability to more effectively breach networks and conduct influence operations.
Microsoft said the “attacks” detected all involved large-language models the partners own and said it was important to expose them publicly even if they were “early-stage, incremental moves.”
Cybersecurity firms have long used machine-learning on defense, principally to detect anomalous behavior in networks. But criminals and offensive hackers use it as well, and the introduction of large-language models led by OpenAI’s ChatGPT upped that game of cat-and-mouse.
Microsoft has invested billions of dollars in OpenAI, and Wednesday’s announcement coincided with its release of a report noting that generative AI is expected to enhance malicious social engineering, leading to more sophisticated deepfakes and voice cloning . A threat to democracy in a year where over 50 countries will conduct elections, magnifying disinformation and already occurring,
Here are some examples Microsoft provided. In each case it said all generative AI accounts and assets of the named groups were disabled:
— The North Korean cyberespionage group known as Kimsuky has used the models to research foreign think tanks that study the country, and to generate content likely to be used in spear-phishing hacking campaigns.
— Iran’s Revolutionary Guard has used large-language models to assist in social engineering, in troubleshooting software errors, and even in studying how intruders might evade detection in a compromised network. That includes generating phishing emails “including one pretending to come from an international development agency and another attempting to lure prominent feminists to an attacker-built website on feminism.” The AI helps accelerate and boost the email production.
— The Russian GRU military intelligence unit known as Fancy Bear has used the models to research satellite and radar technologies that may relate to the war in Ukraine.
— The Chinese cyberespionage group known as Aquatic Panda — which targets a broad range of industries, higher education and governments from France to Malaysia — has interacted with the models “in ways that suggest a limited exploration of how LLMs can augment their technical operations.”
— The Chinese group Maverick Panda, which has targeted U.S. defense contractors among other sectors for more than a decade, had interactions with large-language models suggesting it was evaluating their effectiveness as a source of information “on potentially sensitive topics, high profile individuals, regional geopolitics, US influence, and internal affairs.”
In a separate blog published Wednesday, OpenAI said the techniques discovered were consistent with previous assessments that found its current GPT-4 model chatbot offers “only limited, incremental capabilities for malicious cybersecurity tasks beyond what is already achievable with publicly available, non-AI powered tools.”
Last April, the director of the U.S. Cybersecurity and Infrastructure Security Agency, Jen Easterly, told Congress that “there are two epoch-defining threats and challenges. One is China, and the other is artificial intelligence.”
Easterly said at the time that the U.S. needs to ensure AI is built with security in mind.
Critics of the public release of ChatGPT in November 2022 — and subsequent releases by competitors including Google and Meta — contend it was irresponsibly hasty, considering security was largely an afterthought in their development.
“Of course bad actors are using large-language models — that decision was made when Pandora’s Box was opened,” said Amit Yoran, CEO of the cybersecurity firm Tenable.
Some cybersecurity professionals complain about Microsoft’s creation and hawking of tools to address vulnerabilities in large-language models when it might more responsibly focus on making them more secure.
“Why not create more secure black-box LLM foundation models instead of selling defensive tools for a problem they are helping to create?” asked Gary McGraw, a computer security veteran and co-founder of the Berryville Institute of Machine Learning.
NYU professor and former AT&T Chief Security Officer Edward Amoroso said that while the use of AI and large-language models may not pose an immediately obvious threat, they “will eventually become one of the most powerful weapons in every nation-state military’s offense.”
veryGood! (1)
Related
- Detroit-area police win appeal over liability in death of woman in custody
- Caitlin Clark's scoring record reveals legacies of Lynette Woodard and Pearl Moore
- Missed watching 'The Doomsday Prophet: Truth and Lies' on TV? Here's where to stream it.
- Robert Hur, special counsel in Biden documents case, to testify before Congress on March 12
- Bankruptcy judge questioned Shilo Sanders' no-show at previous trial
- North Carolina removes children from a nature therapy program’s care amid a probe of a boy’s death
- Bella Hadid Gives Rare Look Into Romance with Cowboy Adam Banuelos
- What does Tiger Woods need to do to make the cut at the Genesis Invitational?
- Stock market today: Asian shares mostly decline, shrugging off Wall Street’s overnight rally
- American woman goes missing in Madrid after helmeted man disables cameras
Ranking
- Trump on Day 1: Begin deportation push, pardon Jan. 6 rioters and make his criminal cases vanish
- Iowa’s Caitlin Clark wants more focus on team during final stretch now that NCAA record is broken
- Warm Winter Threatens Recreation Revenue in the Upper Midwest
- Eras Tour in Australia: Tracking Taylor Swift's secret songs in Melbourne and Sydney
- Olivia Munn Randomly Drug Tests John Mulaney After Mini-Intervention
- Survivors of recent mass shootings revive calls for federal assault weapons ban, 20 years later
- Super Bowl LVIII was most-watched program in television history, CBS Sports says
- Man convicted in 2022 shooting of Indianapolis police officer that wounded officer in the throat
Recommendation
-
School workers accused of giving special needs student with digestive issue hot Takis, other abuse
-
Pregnant Giannina Gibelli and Bachelor Nation's Blake Horstmann Reveal Sex of Baby
-
Powerball winning numbers for Feb. 14 drawing: Jackpot rises over $300 million
-
Get a Tan in 1 Hour and Save 46% On St. Tropez Express Self-Tanning Mousse
-
Where is 'College GameDay' for Week 12? Location, what to know for ESPN show
-
Deadly shooting locks down a Colorado college
-
American woman goes missing in Madrid after helmeted man disables cameras
-
Bears great Steve McMichael is responding to medication in the hospital, family says