Bagel 34B v0.2
jondurbin/bagel-34b
An experimental fine-tune of Yi 34b 200k using bagel(opens in new tab). This is the version of the fine-tune before direct preference optimization (DPO) has been applied. DPO performs better on benchmarks, but this version is likely better for creative writing, roleplay, etc.
Modalities
Context
200K
Released
Jan 5, 2024