This is an RWKV 3B model finetuned specifically for the AI TownOpens in new tab project.
RWKVOpens in new tab is an RNN (recurrent neural network) with transformer-level performance. It aims to combine the best of RNNs and transformers - great performance, fast inference, low VRAM, fast training, "infinite" context length, and free sentence embedding.
RWKV 3B models are provided for free, by Recursal.AI, for the beta period. More details hereOpens in new tab.
#rnn
모달리티
컨텍스트
10K
출시일
2023년 12월 10일
지식 기준일
2023년 6월