What is the context length of Llama 3 Stheno 8B v3.3 32K?

Llama 3 Stheno 8B v3.3 32K has a 32,000 token context window.

What other text models does Sao10K have?

Llama 3.1 Euryale 70B v2.2 and Llama 3 8B Lunaris are other text models from Sao10K.

When was Llama 3 Stheno 8B v3.3 32K released?

Llama 3 Stheno 8B v3.3 32K was released on June 27, 2024. Its knowledge cutoff is December 31, 2023.

Sao10K: Llama 3 Stheno 8B v3.3 32K

sao10k/l3-stheno-8b

Model weights

Stheno 8B 32K is a creative writing/roleplay model from Sao10k. It was trained at 8K context, then expanded to 32K context.

Compared to older Stheno version, this model is trained on:

2x the amount of creative writing samples
Cleaned up roleplaying samples
Fewer low quality samples

Modalities

Context

32K

Released

Jun 27, 2024

Knowledge cutoff

Dec 2023

Not currently available through EU in-region routing. In-region routing docs

More models from Sao10K

Llama 3.1 70B Hanami x1

This is Sao10K's experiment over Euryale v2.2.

Text16K context

Llama 3.3 Euryale 70B

Euryale L3.3 70B is a model focused on creative roleplay from Sao10k. It is the successor of Euryale L3 70B v2.2.

Text8K context

Llama 3.1 Euryale 70B v2.2

Euryale L3.1 70B v2.2 is a model focused on creative roleplay from Sao10k. It is the successor of Euryale L3 70B v2.1.

Text131K context$0.85 / $0.85

Llama 3 8B Lunaris

Lunaris 8B is a versatile generalist and roleplaying model based on Llama 3. It's a strategic merge of multiple models, designed to balance creativity with improved logic and general knowledge.

Created by Sao10k, this model aims to offer an improved experience over Stheno v3.2, with enhanced creativity and logical reasoning.

For best results, use with Llama 3 Instruct context template, temperature 1.4, and min_p 0.1.

Text8K context$0.04 / $0.05

Llama 3 Euryale 70B v2.1

Euryale 70B v2.1 is a model focused on creative roleplay from Sao10k.

Text8K context

Fimbulvetr 11B v2

Creative writing model, routed with permission. It's fast, it keeps the conversation going, and it stays in character.

If you submit a raw prompt, you can use Alpaca or Vicuna formats.

Text8K context

Sao10K: Llama 3 Stheno 8B v3.3 32K

Activity

Frequently asked questions

Explore more models

More models from Sao10K

More models from Sao10K

Sao10K: Llama 3 Stheno 8B v3.3 32K

Activity

Frequently asked questions

What is Llama 3 Stheno 8B v3.3 32K?

What is the context length of Llama 3 Stheno 8B v3.3 32K?

What other text models does Sao10K have?

When was Llama 3 Stheno 8B v3.3 32K released?

Explore more models

More models from Sao10K

More models from Sao10K