RWKV v5 3B AI Town

This is an RWKV 3B model finetuned specifically for the AI Town project. RWKV is an RNN (recurrent neural network) with transformer-level performance. It aims to combine the best of RNNs and transformers - great performance, fast inference, low VRAM, fast training, "infinite" context length, and free sentence embedding. RWKV 3B models are provided for free, by Recursal.AI, for the beta period.

RWKV v5 3B AI Town dispose d’une fenêtre de contexte de 10 000 jetons.

RWKV v5 3B AI Town est sorti le 10 décembre 2023. Ses connaissances s’arrêtent au 30 juin 2023.