OpenHermes 2.5 Mistral 7B

teknium/openhermes-2.5-mistral-7b

Created Nov 20, 20234,096 context

A continuation of OpenHermes 2 model, trained on additional code datasets. Potentially the most interesting finding from training on a good ratio (est. of around 7-14% of the total dataset) of code instruction was that it has boosted several non-code benchmarks, including TruthfulQA, AGIEval, and GPT4All suite. It did however reduce BigBench benchmark score, but the net gain overall is significant.

Recent activity on OpenHermes 2.5 Mistral 7B

Tokens processed per day

Feb 9Feb 13Feb 21Feb 25Mar 1Mar 5Mar 9Mar 13Mar 17Mar 21Mar 25Mar 29Apr 205.5M11M16.5M22M
    OpenHermes 2.5 Mistral 7B - API, Providers, Stats | OpenRouter