Stheno 8B 32K is a creative writing/roleplay model from Sao10k. It was trained at 8K context, then expanded to 32K context.
Compared to older Stheno version, this model is trained on:
- 2x the amount of creative writing samples
- Cleaned up roleplaying samples
- Fewer low quality samples