augment_model_mistral-fp8 / chat_template.jinja
Ba2han's picture
Upload fixed FP8 model (multimodal layers removed)
f434b70 verified
raw
history blame contribute delete
334 Bytes
{{ bos_token }}{% for message in messages %}{% if message['role'] == 'user' %}{{ '[INST]' + message['content'] }}{% if loop.index0 == 1 and messages[0]['role'] == 'system' %}{{ '
' + messages[0]['content'] }}{% endif %}{{ '[/INST]' }}{% elif message['role'] == 'assistant' %}{{ message['content'] + eos_token }}{% endif %}{% endfor %}