A large LLM created by combining two fine-tuned Llama 70B models into one 120B model. Combines Xwin and Euryale. Credits to - @chargoddard for developing the framework used to merge the model - mergekit. - @Undi95 for helping with the merge ratios. #merge
Goliath 120B has a 6,144 token context window.
Goliath 120B was released on November 10, 2023. Its knowledge cutoff is December 31, 2023.