Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes
Paper
•
2402.05406
•
Published
Bonsai Reasoning
Working on improving reasoning of Bonsai Paper.
-
luciodery/Bonsai-PrunedPhi-1.8B
2B • Updated • 51 • 1Note Original Model with 10 iterations to get 50% sparsity
vashistht/bonsai-reasoning-adapter_prune_c4_ft_wiki
UpdatedNote Finetuned Bonsai (pruned on C4) on Wikitext