This is an RWKV 3B model finetuned specifically for the AI Town(opens in new tab) project.
RWKV(opens in new tab) is an RNN (recurrent neural network) with transformer-level performance. It aims to combine the best of RNNs and transformers - great performance, fast inference, low VRAM, fast training, "infinite" context length, and free sentence embedding.
RWKV 3B models are provided for free, by Recursal.AI, for the beta period. More details here(opens in new tab).
#rnn
Modalities
Context
10K
Released
Dec 10, 2023
Knowledge Cutoff
Jun 2023
Token volume and request traffic to this model over time.
This is an RWKV 3B model finetuned specifically for the AI Town project. RWKV is an RNN (recurrent neural network) with transformer-level performance. It aims to combine the best of RNNs and transformers - great performance, fast inference, low VRAM, fast training, "infinite" context length, and free sentence embedding. RWKV 3B models are provided for free, by Recursal.AI, for the beta period.
RWKV v5 3B AI Town has a 10,000 token context window.
RWKV v5 3B AI Town was released on December 10, 2023. Its knowledge cutoff is June 30, 2023.