Boosting Alignment After Unlearning in Text-to-Image Models
How to maintain model alignment after machine unlearning operations in text-to-image generative models.
3526 words
|
18 minutes
OVERT: Benchmarking Over-Refusal in Text-to-Image Generation Models
Examining the OVERT benchmark that measures excessive refusal in text-to-image models, revealing how safety filters may be overly restrictive.
2789 words
|
14 minutes
CodeHalu: Investigating Code Hallucinations in LLMs via Execution-Based Verification
How execution-based verification reveals the extent and patterns of code hallucinations in large language models.
3292 words
|
16 minutes
Hidden Persuaders: How LLM Political Leaning Influences Voter Decisions
Investigating how the political leanings embedded in large language models can subtly influence voter behavior and democratic processes.
3440 words
|
17 minutes
TrojDiff: Trojan Attacks on Diffusion Models with Diverse Targets
How TrojDiff demonstrates diverse trojan attack strategies against diffusion models, revealing vulnerabilities in generative AI systems.
3141 words
|
16 minutes
Rethinking Proxy-Model Practice: Can Small Training Runs Guide Data Curation?
Examining whether small-scale proxy training runs can reliably guide data curation decisions for large language model training.
2155 words
|
11 minutes
SafeKey: Amplifying Aha-Moment Insights for Better LLM Safety Reasoning
How SafeKey leverages insight moments in chain-of-thought reasoning to improve LLM safety decision-making.
2913 words
|
15 minutes
Evolving AI Collectives: Enhancing Human Diversity and Enabling Self-Regulation
How evolving AI collectives can preserve and enhance human diversity while enabling self-regulation mechanisms in multi-agent systems.
2576 words
|
13 minutes
GuardAgent: Safeguarding LLM Agents Through Knowledge-Enabled Reasoning
How GuardAgent uses knowledge-enabled reasoning to build adaptive guardrails that protect LLM agents from adversarial exploitation.
2903 words
|
15 minutes
Why LLMs Hallucinate: Connecting the Dots with Subsequence Associations
Uncovering the mechanistic basis of LLM hallucinations through subsequence association analysis and what it means for building more reliable models.
3213 words
|
16 minutes
Agent Runtime Security and Sandboxing: Securing Autonomous AI Systems
A deep dive into agent runtime security and sandboxing solutions including OpenShell, OpenSandbox, CubeSandbox, Aegis EDR, and agent governance toolkits for safely running autonomous AI systems.
1035 words
|
5 minutes
In-Context Watermarks: A New Approach to LLM Content Attribution
Exploring in-context watermarking techniques that embed detectable signals in LLM outputs without degrading generation quality.
2747 words
|
14 minutes
The Secret Sharer: How Neural Networks Unintentionally Memorize and Leak Secrets
The seminal work revealing that neural networks unintentionally memorize sensitive training data, enabling extraction of secrets like credit card numbers and passwords.
2882 words
|
14 minutes
VMDT: Decoding the Trustworthiness of Video Foundation Models
A comprehensive evaluation framework for measuring the trustworthiness and safety of video foundation models.
3138 words
|
16 minutes
Undetectable Watermarks for Generative Image Models
A breakthrough in provably undetectable watermarking for generative image models that preserves image quality while enabling reliable detection.
3219 words
|
16 minutes
Multimodal Situational Safety: Context-Aware Safety for Multimodal AI
How situational context determines whether multimodal AI responses are safe or harmful, and a framework for context-aware safety evaluation.
3351 words
|
17 minutes
Robust Physical-World Attacks on Deep Learning: Why Stop Signs Can Fool Self-Driving Cars
The landmark demonstration that simple physical modifications to road signs can consistently fool deep learning-based visual classification in the real world.
2773 words
|
14 minutes
Deepfake Detection, AI Supply Chain Attacks, and the Agent Skill Threat
A guide to emerging AI security threats including deepfake-as-a-service, the CLI-Anything agent backdoor attack, skill supply chain security, and the growing importance of content authenticity and provenance standards.
948 words
|
5 minutes
SHINE: Shielding Backdoors in Deep Reinforcement Learning
How SHINE provides provable defenses against backdoor attacks in deep reinforcement learning systems.
3346 words
|
17 minutes
Adversarial Examples for Generative Models: Attacking the Generators
The pioneering work extending adversarial attacks beyond classifiers to generative models, revealing vulnerabilities in GANs and VAEs.
2387 words
|
12 minutes
The Many Faces of Robustness: A Critical Analysis of OOD Generalization
A critical analysis revealing that different notions of robustness in computer vision often conflict, and what this means for building truly reliable AI.
2761 words
|
14 minutes
Redefining Agent Security: Why We Need a Holistic Framework for AI Agent Safety
A position paper arguing that current approaches to AI agent security are fragmented and proposing a unified holistic framework for comprehensive agent safety.
3464 words
|
17 minutes
PixMix: How Dreamlike Pictures Comprehensively Improve AI Safety Measures
How PixMix uses dreamlike image mixtures to simultaneously improve robustness, calibration, and safety across multiple computer vision benchmarks.
2604 words
|
13 minutes
Extracting Training Data from Diffusion Models: Privacy Risks in Generative AI
Extending training data extraction attacks to diffusion models, revealing that generative AI systems pose significant privacy risks through memorization.
3454 words
|
17 minutes