Hugging Face: Zephyr 7B

Zephyr is a series of language models that are trained to act as helpful assistants. Zephyr-7B-β is the second model in the series, and is a fine-tuned version of mistralai/Mistral-7B-v0.1 that was trained on a mix of publicly available, synthetic datasets using Direct Preference Optimization (DPO).

Zephyr 7B dispose d’une fenêtre de contexte de 4 096 jetons.

Zephyr 7B est sorti le 2 août 2023. Ses connaissances s’arrêtent au 31 octobre 2023.