OpenHermes 2.5 Mistral 7B

A continuation of OpenHermes 2 model, trained on additional code datasets. Potentially the most interesting finding from training on a good ratio (est. of around 7-14% of the total dataset) of code instruction was that it has boosted several non-code benchmarks, including TruthfulQA, AGIEval, and GPT4All suite.

OpenHermes 2.5 Mistral 7B hat ein Kontextfenster von 4.096 Token.

OpenHermes 2.5 Mistral 7B wurde am 20. November 2023 veröffentlicht. Der Wissensstand reicht bis zum 30. September 2023.