NCII Prompt Guard
NCII prompt guards are light-weight text classication models, to be deployed as guardrails to lower abuse risks for image and video editing apps.
Updated β’ 59Note Article published to situate the NCII Prompt Guard model and dataset release within the broader context of Non-Consensual Iintimate Imagery (NCII) harms, risk governance, and mitigations; and help outline the scope and limitations of text-based guardrails.
hfmlsoc/ncii-prompt-guard-3c
Text Classification β’ 0.3B β’ Updated β’ 60Note 3-class classifier: 0 for low risk, 1 for less clothing without nudity, 2 for block
hfmlsoc/ncii-prompt-guard-5c
Text Classification β’ 0.3B β’ Updated β’ 41Note 5-class classifier: 0 for safe, 1 for low risk ambiguous, 2 for less clothing without nudity, 3 for nudification, 4 for explicit sexualization
Ncii Guard Family Compare
πScore image editing prompts for safety with three NCII guard models
Note Testing space to evaluate the behavior of the different models at different filter thresholds
hfmlsoc/ncii-prompt-guard-data
Viewer β’ Updated β’ 85.8k β’ 202Note Training, validation, and test data for the NCII prompt guard family. Access gated by individual requests
NCII Guard Embedding Atlas
πΊExplore prompt embeddings with interactive map and filters
Note Embedding-based dataset visualization for a subset of the training data and the full dev and test dataset
hfmlsoc/ncii-light-guard-v01
Text Classification β’ 0.3B β’ Updated β’ 8.23k β’ 2Note Previous binary model, training data and disparate performance not available, provided as baseline only