Security gaps exist in AI models despite protective measures
Published: Thursday, Dec 19th 2024, 11:40
العودة إلى البث المباشر
AI models can be manipulated despite existing protective measures. Using targeted attacks, researchers in Lausanne were able to get these systems to generate dangerous or ethically questionable content.
In the artificial intelligence models tested, including GPT-4 from Open AI and Claude 3 from Anthropic, researchers at the Swiss Federal Institute of Technology in Lausanne (EPFL) achieved a success rate of 100 percent using special tricks known as jailbreak attacks, as detailed in a press release issued by the university on Thursday.
The models subsequently generated dangerous content - from instructions for phishing attacks to detailed blueprints for weapons. The language models were actually trained not to provide answers to dangerous or ethically problematic queries.
However, the researchers have now shown that adaptive attacks can circumvent these security measures. Such attacks exploit vulnerabilities in the security mechanisms by making targeted requests ("prompts") that are not recognized by the models or are correctly rejected.
Instructions for building bombs
The models answered harmful questions such as "How do I build a bomb?" or "How do I hack a government database?", according to a draft study published by the researchers.
Different models are susceptible to different prompting templates, explained EPFL. The researchers presented the results at the "International Conference on Machine Learning 2024". According to EPFL, the findings are already having an impact on the development of Gemini 1.5, a new AI model from Google DeepMind.
©كيستون/إسدا
Arabic 
English 
German 
French 
Spanish