Identity and access
The publisher record identifies this repository as tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.5. Its current public snapshot is b1f8317099a97e790ec872c1225ca155979b4816. Access is public repository; review the applicable licence and publisher terms; the recorded licence label is ['llama3.3', 'gemma']. A public repository or gated download does not establish permission for every use.
Configuration facts
The pinned configuration reports model type llama and architecture LlamaForCausalLM. The model hub tags it for text-generation; these labels describe repository metadata and do not establish benchmark performance.
- head_dim: 128
- hidden_size: 4096
- intermediate_size: 14336
- max_position_embeddings: 131072
- num_attention_heads: 32
- num_hidden_layers: 32
- num_key_value_heads: 8
- rms_norm_eps: 1e-05
- rope_theta: 500000.0
- torch_dtype: bfloat16
- vocab_size: 128256
Model-specific qualification
Before deployment, confirm the exact tokenizer and chat template, supported context length, serving engine, output format, and workload-specific evaluation. The model card and configuration describe artifacts, not an available service or a performance guarantee.
Weight-memory planning
This guide does not retain an independently verified logical parameter count, so it omits a numeric weight-memory estimate. If a count is verified for this exact repository revision, use parameter count × bytes per parameter for a weights-only floor; then account separately for KV cache, context, activations, runtime, and concurrency.
Revision and reproducibility
The metadata and configuration are pinned to revision b1f8317099a97e790ec872c1225ca155979b4816. Pin this commit when reproducing an evaluation. Repository branches can change, and this source check does not validate the model weights themselves.
Published record
- Task: text-generation
- Model type: llama
- Architecture: LlamaForCausalLM
- Licence label: ['llama3.3', 'gemma']
- Access: public repository; review the applicable licence and publisher terms
- Revision: b1f8317099a97e790ec872c1225ca155979b4816