Controllable Generation of Diverse Dermatological Imagery for Fair and Efficient Malignancy Classification
Paper • 2607.12987 • Published
How to use hcarrion/fibrous_papule with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-2-1-base", torch_dtype=torch.bfloat16, device_map="cuda")
pipe.load_textual_inversion("hcarrion/fibrous_papule")These are the textual inversion adaptation weights for stabilityai/stable-diffusion-2-1-base to generate images of fibrous papule.
This model was introduced as part of the paper: Controllable Generation of Diverse Dermatological Imagery for Fair and Efficient Malignancy Classification (MICCAI 2026).
The cgDDI framework learns disease-specific concept tokens via textual inversion and fine-tunes latent diffusion models to generate realistic, skin-tone-balanced synthetic imagery. These synthetic images are used to train fairer and more robust malignancy classifiers.
@inproceedings{carrion2026cgddi,
title = {Controllable Generation of Diverse Dermatological Imagery for Fair and Efficient Malignancy Classification},
author = {Carri{\'o}n, H{\'e}ctor and Norouzi, Narges},
booktitle = {Medical Image Computing and Computer-Assisted Intervention (MICCAI)},
year = {2026},
publisher = {Springer},
series = {Lecture Notes in Computer Science}
}
Base model
stabilityai/stable-diffusion-2-1-base