Bagel 34B v0.2

jondurbin/bagel-34b

Updated Jan 58,000 context

An experimental fine-tune of Yi 34b 200k using bagel. This is the version of the fine-tune before direct preference optimization (DPO) has been applied. DPO performs better on benchmarks, but this version is likely better for creative writing, roleplay, etc.

Tokens processed per day by Bagel 34B v0.2