Vision-Language Models (VLMs) are Artificial Intelligence (AI) systems that can interpret and comprehend visual and written inputs. Incorporating Large Language Models (LLMs) into VLMs has enhanced their comprehension of intricate inputs. Though VLMs have made encouraging development and gained significant popularity, there are still limitations regarding their effectiveness in difficult settings.
The core of VLMs, represented by LLMs, has been shown to provide inaccurate or harmful content under certain conditions. This raises questions about new vulnerabilities to deployed VLMs that may go unnoticed because of their special blend of textual and visual input and also raises worries about potential risks connected with VLMs that are built upon LLMs.
Early examples have demonstrated weaknesses in red teaming, including the production of discriminating statements and unintentional disclosure of personal information. Thus, a thorough stress test, including red teaming situations, becomes essential for the safe deployment of VLMs.
Since there is no comprehensive and systematic red teaming benchmark for current VLMs, a team of researchers has recently introduced The Red Teaming Visual Language Model (RTVLM) dataset. This dataset has been presented in order to close the gap with an emphasis on red teaming situations, including image-text input.
Ten subtasks have been included in this dataset, grouped under four main categories: faithfulness, privacy, safety, and fairness. These subtasks include image misleading, multi-modal jailbreaking, face fairness, etc. The team has shared that RTVLM is the first red teaming dataset that thoroughly compares the state-of-the-art VLMs in these four areas.
The team has shared that after a thorough examination, when exposed to red teaming, ten well-known open-sourced VLMs struggled to differing degrees, with performance differences of up to 31% when compared to GPT-4V. This implies that handling red teaming scenarios presents difficulties for the current generation of open-sourced VLMs.
The team has used Supervised Fine-tuning (SFT) with RTVLM to apply red teaming alignment to LLaVA-v1.5. The model’s performance improved significantly, as evidenced by the 10% rise in the RTVLM test set, the 13% increase in MM-hallu, and the lack of a discernible reduction in MM-Bench. With regular alignment data, this outperforms existing LLaVA-based models. This study confirmed that red teaming alignment is missing from current open-sourced VLMs, although alignment can improve the durability of these systems in difficult situations.
The team has summarized their primary contributions as follows.
- In red teaming settings, all ten of the top open-source Vision-Language Models exhibit difficulties, with performance disparities reaching up to 31% when compared to GPT-4V.
- The study attests that present VLMs do not have red teaming alignment. The RTVLM dataset on LLaVA-v1.5, when Supervised Fine-tuning (SFT) is applied, yields stable performance on MM-Bench, a 13% boost on MM-hallu, and a 10% improvement on the RTVLM test set. This outperforms other LLaVA models that depend on consistent alignment data.
- The study offers insightful information and is the first red teaming standard for visual language models. In addition to pointing out weaknesses, it offers solid suggestions for further development.
In conclusion, the RTVLM dataset is a useful tool for comparing the performance of existing VLMs in a number of important areas. The results further emphasize how crucial red teaming alignment is to enhancing VLM robustness.
Check out the Paper. All credit for this research goes to the researchers of this project. Also, don’t forget to follow us on Twitter. Join our 36k+ ML SubReddit, 41k+ Facebook Community, Discord Channel, and LinkedIn Group.
If you like our work, you will love our newsletter..
Don’t Forget to join our Telegram Channel
The post This AI Paper from China Sheds Light on the Vulnerabilities of Vision-Language Models: Unveiling RTVLM, the First Red Teaming Dataset for Multimodal AI Security appeared first on MarkTechPost.
#AIShorts #Applications #ArtificialIntelligence #EditorsPick #Staff #TechNews #Technology #Uncategorized [Source: AI Techpark]