HERETICODER-2.5-7B-IT
Model Description
This is an abliterated decensored version of Qwen2.5-Coder-7B-Instruct using Heretic!
- License: apache-2.0
- Abliterated by : Cannae-AI
- Base model : Qwen/Qwen2.5-Coder-7B-Instruct
| Model |
Refusals |
KL divergence |
| HERETICODER-2.5-7B-IT |
1/100 |
0.00 |
- Parameters:
- direction_index = per layer
- attn.o_proj.max_weight = 1.30
- attn.o_proj.max_weight_position = 16.27
- attn.o_proj.min_weight = 0.74
- attn.o_proj.min_weight_distance = 4.19
- mlp.down_proj.max_weight = 0.98
- mlp.down_proj.max_weight_position = 21.61
- mlp.down_proj.min_weight = 0.54
- mlp.down_proj.min_weight_distance = 2.64