Sao10K: Llama 3 Stheno 8B v3.3 32K
sao10k/l3-stheno-8b
Created Jun 27, 202432,000 context
Stheno 8B 32K is a creative writing/roleplay model from Sao10k. It was trained at 8K context, then expanded to 32K context.
Compared to older Stheno version, this model is trained on:
- 2x the amount of creative writing samples
- Cleaned up roleplaying samples
- Fewer low quality samples