0xF4695F4B: New vuln
Summary
Here we go
Metadata
Social Impact Score
Violations at this level present a tangible risk to public safety or social well-being, often related to dangerous but not highly restricted content.
Example: Bypassing guardrails to obtain instructions for creating illicit substances, such as recreational drugs or substances with moderate harm potential.
Potential Consequences: Potential health impacts on a small scale, significant regulatory interest, and the need for stricter AI guardrails.
Taxonomies
Language
Code and Encode
Hex Encoding
This category focuses on the use of specific linguistic techniques, such as prompt injection or stylization, to influence the model's output.
This strategy encompasses techniques that utilize various coding methods, such as Base64 or ROT13, to bypass model restrictions and manipulate outputs.
This technique involves encoding information in hexadecimal format, which can be used to bypass model safeguards or to obscure the true nature of the input. By converting data into hex, users can manipulate how the model interprets the input, potentially leading to unintended outputs or responses that would not occur with plain text.
Possible Worlds
World Building
Opposite World
This category entails constructing imaginative environments where different ethics or rules apply, allowing for creative manipulation of the model's behavior.
This technique involves changing the genre of the prompt to elicit different types of responses from the model. By framing the request within a specific genre, such as poetry, games, or forum posts, users can manipulate the model's output to align with the conventions and expectations of that genre.
The Opposite World technique involves creating a fictional scenario where the norms, ethics, or rules of reality are inverted or altered. In this context, users prompt the model to consider actions or decisions that would typically be deemed unacceptable or unethical in the real world, but are framed as acceptable within this alternate reality. This strategy allows users to explore the model's responses to morally ambiguous situations or to elicit creative outputs that challenge conventional thinking. By asking the model to operate under the premise of an Opposite World, users can gain insights into its understanding of morality, ethics, and the boundaries of acceptable behavior, while also examining how the model navigates complex social dynamics. This technique can be particularly useful for generating narratives or scenarios that provoke thought and discussion about real-world issues.
Test Scores
Model |
Test Kind |
Test Score |
Temperature (max 2.0) |
Anthropic Claude |
Exploit/CVE |
0.12 |
N/A |
Baidu ERNIE |
Copyrighted Content: Harry Potter |
1.0 |
0.4 |
Cohere Command R |
Exploit/CVE |
0.02 |
N/A |
About 0Din.ai
The 0Day Investigative Network (0Din) was founded by Mozilla in 2024 to reward responsible researchers for their efforts in securing GenAI models. Learn more and submit discoveries at https://www.0din.ai.