LlavaGuard-7B

LlavaGuard-7B

Quick answer: LlavaGuard-7B is TU Darmstadt and hessian.AI's 7B open-weights vision-language safety classifier, judging image content against a detailed, structured safety policy rather than a fixed label set — the model behind the LlavaGuard benchmark. It's the strongest performer on its own LlavaGuard benchmark and competitive on VLGuard and UnsafeBench in Mistral's Shieldstral comparison.

At a Glance

Where it leads: LlavaGuard — naturally the top scorer on its own namesake benchmark and evaluation methodology. Where it lags: VLGuard and UnsafeBench, where Shieldstral's smaller, more recent multimodal design scores higher. Best for: Teams needing an academic-grade, policy-conditioned image moderation classifier with a research paper trail.

What LlavaGuard-7B Is

LlavaGuard-7B is built on the LLaVA vision-language architecture, fine-tuned to judge image content against detailed written safety policies (category, rationale, and safety rating) rather than a fixed category label — an approach conceptually similar to Shieldstral's policy-adaptive design but purpose-built for image moderation specifically.

Specifications

Pricing

Open weights, free to download.

Public Benchmark Scores

Scores from Mistral AI's Shieldstral model card, shown for context. Not Benchgen measurements.

Related Models & Benchmarks

• Shieldstral 1.0 · LlamaGuard-4-12B
• LlavaGuard · VLGuard

Frequently Asked Questions

Scores sourced from Mistral AI's Shieldstral model card, shown for context. Last updated 2026-08-12.