Hugging Face: Zephyr 7B

Zephyr is a series of language models that are trained to act as helpful assistants. Zephyr-7B-β is the second model in the series, and is a fine-tuned version of mistralai/Mistral-7B-v0.1 that was trained on a mix of publicly available, synthetic datasets using Direct Preference Optimization (DPO).

Zephyr 7B hat ein Kontextfenster von 4.096 Token.

Zephyr 7B wurde am 2. August 2023 veröffentlicht. Der Wissensstand reicht bis zum 31. Oktober 2023.