What does Llama Guard do?

medium

Answer

$Llama Guard (Meta, 2023 / 2024) is a small classifier fine-tuned from Llama-2/3 to score inputs and outputs against a safety taxonomy (violence, sexual, hate, self-harm, criminal, weapons, ...).$
$Outputs 'safe' / 'unsafe' + specific category.$
$Deployed as pre-filter (block harmful inputs) and post-filter (block unsafe outputs).$
$Open-weight, so on-premise deployments can meet strict compliance.$
$Alternatives: OpenAI Moderation API, Perspective API, Azure Content Safety.$
$Belt-and-suspenders around aligned models.$

Check yourself — multiple choice

Same as ChatGPT
Small classifier that flags safe/unsafe I/O against a safety taxonomy; open-weight, deployed as pre/post-filter around aligned models
Only training tool
Not available

Llama Guard: open-weight safety classifier for pre/post filtering.

#safety#guardrails

214 interview questions in this topic.