deep-ignorance-cb-sft-ret2-rm10-orth5

Unlearned model using orthogonal circuit breakers (SFT, full-rank).

Base model: EleutherAI/deep-ignorance-unfiltered

Training hyperparameters

Parameter Value
Algorithm Orth Circuit Breakers
Mode SFT (full-rank)
retain_coef 2
remove_coef 10
orth_coef 5
Learning rate 1e-4

Evaluation results

Benchmark Accuracy
WMDP Bio Robust 0.2903
MMLU 0.4440
Downloads last month
52
Safetensors
Model size
7B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for EleutherAI/deep-ignorance-cb-sft-ret2-rm10-orth5

Unable to build the model tree, the base model loops to the model itself. Learn more.