What is Goliath 120B?

A large LLM created by combining two fine-tuned Llama 70B models into one 120B model. Combines Xwin and Euryale. Credits to - @chargoddard for developing the framework used to merge the model - mergekit. - @Undi95 for helping with the merge ratios. #merge

What is the context length of Goliath 120B?

Goliath 120B has a 6,144 token context window.

When was Goliath 120B released?

Goliath 120B was released on November 10, 2023. Its knowledge cutoff is December 31, 2023.

Goliath 120B

alpindale/goliath-120b

Model weights

A large LLM created by combining two fine-tuned Llama 70B models into one 120B model. Combines Xwin and Euryale.

Credits to

@chargoddard for developing the framework used to merge the model - mergekit.
@Undi95 for helping with the merge ratios.

#merge

Modalities

Context

Released

Nov 10, 2023

Knowledge cutoff

Dec 2023

Not currently available through EU in-region routing. In-region routing docs

Frequently asked questions

More models from Alpindale

Magnum 72B

From the maker of Goliath, Magnum 72B is the first in a new family of models designed to achieve the prose quality of the Claude 3 models, notably Opus & Sonnet.

The model is based on Qwen2 72B and trained with 55 million tokens of highly curated roleplay (RP) data.

Text16K context

Goliath 120B

Activity

Frequently asked questions

Explore more models

More models from Alpindale

More models from Alpindale