Study reveals AI model vulnerability to manipulation in military scenarios
Analysts found that modern neural networks can identify civilian objects as military targets if the prompt is framed as a game.
💡TechPhoto: RBC-Ukraine
Key points
- AI models mistakenly mark civilian objects as targets
- Manipulation via 'game' framing bypasses safety filters
- Developers acknowledge the issue and are strengthening safeguards
Risks of AI in military applications
A new study by Vals has demonstrated critical security gaps in leading artificial intelligence models, such as Claude Opus 5.5, OpenAI, and Google. Experiments revealed that neural networks are capable of misclassifying civilian objects, including schools and people, as potential military targets.
Researchers utilized real satellite imagery and drone footage to test the AI's ability to perform autonomous analysis. It turned out that the models' safety filters are easily bypassed: one only needs to add a statement to the prompt that the events are part of a "game." Under these conditions, the Claude Opus 5.5 model selected a civilian school as a target in 72% of test cases.
Developer response and security threats
Representatives from the developing companies, including Anthropic and OpenAI, acknowledged the findings as unacceptable and announced work on strengthening safety algorithms. Despite technical limitations, such as a lack of onboard computing power for drones, experts warn of the danger of using publicly available AI tools to process large amounts of battlefield data.
There is a risk that data obtained through manipulation could be used to train automated weapon-targeting systems. This highlights the need for strict control over the development of technologies capable of influencing decision-making in critical situations.
Source RBC-Ukraine — rbc.ua/ukr/news/dostatno-nazvati-boyovi-diyi-groyu-claude-179501202… ↗
Read next
Energy forecast: what Chernihiv residents should expect in the coming months
Experts predict cyclical power outages due to Russian attacks on energy infrastructure over the next two months.
Ukraine national football team to learn Euro 2028 qualifying opponents: draw details
UEFA has confirmed the list of participants for the Euro 2028 qualifiers. Ukraine has been placed in the third pot for the draw.
⚽SportSports Isolation Challenged: How Nations Respond to the Return of Russian Athletes
International sports federations are gradually lifting restrictions on Russian athletes, but individual nations are implementing their own visa barriers.
👥SocietyChernihiv artisan creates unique handmade herbal dolls filled with local plants
Chernihiv resident Yuliia Pochechun has been sewing for over a decade, recently shifting her focus to crafting aromatic fabric dolls stuffed with regional therapeutic her…
🏛️PoliticsDiplomatic protocol at the summit in China: details of the leaders' photo
During the APEC summit in China, protocol details regarding the meetings of the leaders of the USA, China, and Russia drew significant attention.
Official Exchange Rates: NBU Strengthens Hryvnia Against Dollar and Euro
The National Bank of Ukraine has announced new official exchange rates, showing an increase in the hryvnia's value.