How to use from the
Use from the
Diffusers library
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline

# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-2-1-base", dtype=torch.bfloat16, device_map="cuda")
pipe.load_textual_inversion("hcarrion/xanthogranuloma")

cgDDI: Controllable Generation of Diverse Dermatological Imagery - xanthogranuloma

This repository contains textual inversion adaptation weights for stabilityai/stable-diffusion-2-1-base representing the xanthogranuloma disease concept.

It was introduced as part of the cgDDI framework in the paper Controllable Generation of Diverse Dermatological Imagery for Fair and Efficient Malignancy Classification.

cgDDI Framework Overview

cgDDI (Controllable Generation of Diverse Dermatological Imagery) is a hybrid framework that:

  1. Synthesizes realistic healthy skin samples without disturbing other input properties.
  2. Maps single-sample rare lesions onto novel skin-tones and locations non-parametrically.
  3. Allows for efficient parametric generation with as few as 10 training samples via textual inversion and LoRA.

This checkpoint corresponds to one of the 65 disease-conditioned concept tokens learned using textual inversion to generate realistic dermatological imagery.

Citation

@inproceedings{carrion2026cgddi,
  title     = {Controllable Generation of Diverse Dermatological Imagery for Fair and Efficient Malignancy Classification},
  author    = {Carri{\'o}n, H{\'e}ctor and Norouzi, Narges},
  booktitle = {Medical Image Computing and Computer-Assisted Intervention (MICCAI)},
  year      = {2026},
  publisher = {Springer},
  series    = {Lecture Notes in Computer Science}
}
Downloads last month
24
Safetensors
Model size
0.9B params
Tensor type
F16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for hcarrion/xanthogranuloma

Adapter
(712)
this model

Paper for hcarrion/xanthogranuloma