Bagel 34B v0.2
jondurbin/bagel-34b
Created Jan 5, 2024200,000 context
An experimental fine-tune of Yi 34b 200k using bagel. This is the version of the fine-tune before direct preference optimization (DPO) has been applied. DPO performs better on benchmarks, but this version is likely better for creative writing, roleplay, etc.