A large LLM created by combining two fine-tuned Llama 70B models into one 120B model. Combines Xwin and Euryale.
Credits to
#merge
Modalities
Context
6K
Released
Nov 10, 2023
Knowledge Cutoff
Dec 2023
Token volume and request traffic to this model over time.
A large LLM created by combining two fine-tuned Llama 70B models into one 120B model. Combines Xwin and Euryale. Credits to - @chargoddard for developing the framework used to merge the model - mergekit. - @Undi95 for helping with the merge ratios. #merge
Goliath 120B has a 6,144 token context window.
Goliath 120B was released on November 10, 2023. Its knowledge cutoff is December 31, 2023.