leftyfeep/ape-fiction-2-mistral-nemo

(A)lgorithmic (P)attern (E)mulation - Fiction!

Same thing I did before in version 1, but with a much larger dataset. I included the full-length stories and novels up to 100k context dataset that I used for version 1. To that dataset I merged three other gutenberg-based datasets, which split the text into chapters:

• https://huggingface.co/datasets/jondurbin/gutenberg-dpo-v0.1
• https://huggingface.co/datasets/nbeerbower/gutenberg2-dpo
• https://huggingface.co/datasets/leftyfeep/fiction-chapters-24kmax

The merged dataset has about 7200 entries.

Uploaded finetuned model

• Developed by: leftyfeep
• License: apache-2.0
• Finetuned from model : unsloth/Mistral-Nemo-Instruct-2407-bnb-4bit

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.